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Preface 



The emergence of the concept of a computable function over fifty years 
ago marked the birth of a new branch of mathematics: its importance may 
be judged from the fact that it has had applications and implications in 
fields as diverse as computer science, philosophy and the foundations of 
mathematics, as well as in many other areas of mathematics itself. This 
book is designed to be an introduction to the basic ideas and results of 
co mput ability theory lor recursion theory, as it is traditionally known 
among mathematicians). 

The initial purpose of computability theory is to make precise the 
intuitive idea of a computable function; that is, a function whose values 
can be calculated in some kind of automatic or effective way. Thereby we 
can gain a clearer understanding of this intuitive idea; and only thereby 
can we begin to explore in a mathematical way the concept of compu- 
tability as well as the many related ideas such as decidability and effective 
enumerability. A rich theory then arises, having both positive and 
negative aspects (here we are thinking of non -computability and undzci- 
dabihty results!, which it is the aim of this book to introduce. 

We could describe computability theory, from the viewpoint of 
computer science, as beginning with the question What can computer* do 
in principle (without restrictions of space, time or money!? -and, by 
implication - What are their inherent theoretical limitations? Thus this 
bonk is no: about real computers and their hardware, nor is it about 
programming languages and techniques. Nevertheless, our subject 
matter is part of the theoretical background to the real world of 
computers and their use, and should be of interest to the computing 
community. 

For the basic definition of computability we have used the 'idealised 
computer' or register machine approach: we have found that this is readily 
grasped by students, most of whom are aware of the idea of a computer. 
(We do not, however, assume such an awareness (although it is helpful) 



and even less do we assume any practical experience with computers or 
calculators.) Our approach is mathematically equivalent to the many 
others that have been discovered, including Turing machines, the 
favourite of many. (We discuss these equivalences in chapter 3.) 

This text grew out of a course given lo undergraduates in mathematics 
and computer science at the University of Hull. The reader envisaged is a 
mathematics student with no prior knowledge of this subject, or a student 
of computer science who may wish to supplement his practical expertise 
with something of the theoretical background to his subject. Wc have 
aimed at the second or third year undergraduate level, although the 
earlier chapters covering the basic theory (chapters 1-7) should be within 
the grasp of good students in sixth forms, high schools and colleges (and 
their teachers). The only prerequisites are knowledge of the mathemati- 
cal language of sets and functions (reviewed in the Prologue) and the 
ability to follow a line of mathematical reasoning. 

The later chapters (8-12) are largely independent of each other. Thus a 
short introductory course could consist of chapters 1-7 supplemented by 
selection according to taste from chapters 8-12. It has been our aim in 
these later chapters to provide an introduction to some of the 
ramifications and applications of basic computability theory, and thereby 
provide a stepping stone towards more advanced study. To this end, the 
final chapter contains a brief survey of possible directions for further 
study, and some suggestions for further reading. (The two main texts that 
might be regarded as natural sequels to this one are M. L. Mi n sky. 
Computation: Finite and Infinite .Machines, which would complement the 
present volume by its broad and comprehensive study of computation (as 
opposed to computability), and H. Rogers. Theory of Recursive Functions 
and Effective Computability, which provides a more advanced treatment 
of recursion theory in depth. ) 

Many people have helped towards the writing of this book. I would first 
thank John Cleave, who taught me recursive function theory in a gradu- 
ate course at the University of Bristol in 1966, and introduced me to the 
register machine approach that I have used here. I have greatly appreci- 
ated the sustained interest and encouragement from Stan Wainer (who 
also made valuable suggestions for the material in chapters 10 and 12) 
and David Jordan: I thank them. I would also like to thank David Jordan 
and Dick Epstein for reading a draft of the manuscript and making many 
valuable comments and corrections. I am grateful to the Cambridge 
University Press for their interest and advice which has resulted in the 
emergence of the completed manuscript. 



Finally, a big lhank you to my wife Mary for her patience and 
encouragement during Ihe many phases of writing and preparation of this 
book; her idealism and understanding have been a sustaining influence 
throughout. 



Prologue 

Prerequisites and notation 



The only prerequisite to be able to read this book is familiarity with the 
basic notations of sets and functions, and Ihe basic ideas of mathematical 
reasoning. Here we shall review these matters, and explain the notation 
and terminology that we shall use. This is mostly standard: so for the 
reader who prefers to move straight to chapter 1 and refer back to this 
prologue only as necessary, we point out that we shall use the word 
function to mean a partial function in general. We discuss this more fully 
below. 



1. Sets 

Generally we shall use capital letters A,B,C... to denote sets. 
We write a £ A to mean that x is a member of A. and we write xi.A to 
mean that x is not a member of A, The natation {x: . . . x . - . } where 
... i ... is some statement involving x means the set of all objects x for 
which ... i ... is true. Thus {x: x is an even natural number} is the set 
{0.2,4,6. ...J. 

If A, B are sets, we write AQB xo mean that A is contained in B (or A 
\s a subsei of B); we use the notation A cfl to mean that Ac 5 but ,4 == B 
(i.e. A is a proper subset of B). The union of the sets A, B is the set 
{x: x e A or x e B (or both)}, and is denoted by A u B ; the intersection of 
A,B is the set {x: r« A and xeB} and is denoted by AnS. The 
difference (or relative complement) of the sets A, B is Ihe set {x: x€ A 
and x£ B) and is denoted by A * B. 

The empty set is denoted by 0. We use the standard symbol H to 
denote the set of natural numbers {0, 1, 2, 3. . . . }. If A is a set of natural 
numbers (i.e. A S h) we write A to denote the complement of A relative 
to % i.e. K\A. We write H' for the set of positive natural numbers 
{1,2,3,...}, and as usual Z denotes the set of integers. 



We write (x, y) to denote the ordered pair of elements z and y; thus 
<x, y) * (y, x) in general. If A. 5 arc sets, the Cartesian product of A andtf 
is the set {(x, y): x •- A and y c S}, and is denoted byAxfl. 

More generally, for elements X|,...,x r we write C*u- •-.**) to 
denote the ordered n-tupU of *i, . . . , X„; an n-luplc is often represented 
by a single boldfaced symbol such as x. If A\ t . - - , A„ arc sets we write 
AiX...xA„ for the set of n-tuples {{x-i,. . .,a^);JjeAi and i 2 e 
A2 . . • x* c A„}. The product Ax AX, . .X A (n times) is abbreviated by 
A"; A' means A. 



2. Functions 

We assume familiarity with the basic idea of a function, and the 
distinction between a function /and a particular value /Cx) at any given x 
where /"is defined. 1 If /"is a function, the domain of /is the set {x: fix) is 
defined), and is denoted Dom(/); we say that fyx) is undefined if 
x£ Dom(/). The set {fix): xc Dom!/};- is called the range of /, and is 
denutedbyRain/). If A and B are sets we say that /"is a function from A; to 
B if Dom(/)s A and Rani/) e 5. We use the notation/: A -* B to mean 
that / is a function from A to B with Domf/) = A. 

A function / is said to be infective if whenever x, y h Dom(/) and x ^ y, 
then f(x) 4 f{y), If f is injective. then f denotes the inverse of f, i.e. the 
unique function g such that Doni(g) = Ran(/'.i and g(/[x)) = x for x€ 
Dom(./). A function /' from A to if is surjective if Ran(/( — R 

If /: A -* B. we say that /' is an injecMon ifrom A to B 1 if it is injective. 
and a surfection (from A to Bi if it is surjective. It is a bisection if it is both 
an injection and a surjection. 

Suppose that / is a function and A" is a set The restriction of / to X, 
denoted by /j X, is the function with domain X r\ Domi f\ whose value for 
x € X n Dom(/J is fix i- We write fiX) for Ran;/ X t. If V is a set. then 
the inverse image of Y under f is the set f 1 \Y) = {x: f(x)€ Y). [Note that 
this is defined even when / is not injective.) 

If/, g are functions- we say that g extends f if' Domi/»cDom(c) and 
f(x) = g\x) for all xeDomtf): in short, f = g Dom(,''l. This is written 



Usuall\ in mathematical texts s function / is defined lo be a set of ardcrcd pai"- 
such thai i!u. p)e/and ,x, ;ie,'. then y - :. and fix ) i* defined to be this- > *c 
do nmbstsr on this definition of 3 function, but our exposition is consisicrlwitn 
it 



^ functions i 

The composition of two functions /, g is the function whose domain is 
the set {x: x eDom(gJ and glx)€Dom(/)}, and whose value is /(g(x» 
when defined. This function is denoted /»g. 

We denote by f& the function that is defined nowhere; i.e. /a has the 
property that DonH/b.) = Rani./ i? ) = 0. Clearly fe = g\0 for anv 

function g. 

Often in computability we shall encounter functions, or expressions 
involving functions, that are not always defined. In such situations the 
following notation is very useful. Suppose that n (at) and fi (x) are expres- 
sions involving the variables x = Ui x«). Then we write 

to mean that for any x. the expressions aix) and Six) are either both 
defined, or both undefined, and if defined they are equal. Thus, for 
example, if/, g are functions, writing /(x ) — g(x > is another way of saying 
that f = g; and for any number y,/(x)=*y means that f(x) is defined and 
fix) — y (since v is always defined). 



Functions of natural numbers For most of this book we shall be 
concerned with functions of natural numbers; that is, functions from ^l' 1 
to fel for various n, most commonly n = 1 or 2. 

A function / from V to Wis called an n-ary function. The value of /at 
an w-tuple {x u .. .,i,,)eDom(/) is written /(Xi,. .. ,*,,), or fix), if x 
represents (xu - - - > *■)• In some texts the phrase parna! function is used 
to describe a function from V to P% whose domain is not necessarily the 
whole of tV. For us the word function means partial function. On 
occasion we will, nevertheless, write partial function to emphasise this 
fact. A total function from V to N is a function whose domain is the whole 
ofN\ 

Particularly with number theoretic functions, we shall blur the dis- 
tinction between a function and its particular values in two fairly standard 
and unambiguous ways. First we shall allow a phrase such as 'Let 
f{x t , ... x,) be a function ..." as a means of indicating that / is an n-ary 
function. Second, we shall otten describe a function in terms of its genera] 
value when this is given by a formula. For instance, 'the function x" means 
'the unary function / whose value at any xeM is x"'; similarly, 'the 
function x — y' is the binary function whose value at [x. y) e ^ is x +y. 

Wc describe the zero function \ -* ftJ by 0; and generally, for m = N, we 
denote the function PsJ -* *y whose value is always m by the boldface 
symbol m. 
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3. Relations and predicates 

If A is a set, a property Mix, x n ) that holds lor is true) for 

some n-tuplcs from A" and does not hold (or is false) for all other si-tuples 
from A is called an n-ary relation or predicate on A. 2 

For example, the property x < y is a binary relation (or predicate) on N; 
2 < 3 holds (or is true) whereas 9 < 5 does not hold (or is false). As another 
example, any n-ary function / from V to \ gives rise to an In + 1 Wary 
predicate Mix, y) given by 

M{x u .... x n , y) if and only if fix, , x„) =» y. 

Equivalence relations and orders (The student unfamilar with these 
notions may prefer to delay reading this paragraph until it is needed in 
chapter 9.) In chapter 9 we shall encounter two special kinds of relations 
on a set A. 

ia ) A binary relation R on a set A is called an equivalence relation if it 
has the following properties for all x.y.ztA: 

li) (refiexivity) Jtfox); 

EH} (symmetry) if R(x, y) then Riy, x); 

(in) (transitivity) if R{x,y) and Riy.z) then Rix, z). 
We think of Rix, y! as saying that x, y are equivalent (in some particular 
sense). Then we define the equivalence class of x as the set {y : Rix, y)}, 
consisting of all things equivalent to x. 

lb) A binary relation R on a set .4 is called a partial order if, for all 
x, y, z = A, 

li) (irrcflexivity) not J?u,jtl; 

tii > (transitivity) if ffu.yland Riy.z) then Rix, z). 
A partial order is usually denoted by the symbol <, and wc write x<y 
rather than <(x, y). A partial order is often defined by first defining < 
(meaning < or =), with the properties 

(i) x ^ x; 

Hi) if x s y and y^x then x = y ; 

(iii) & is transitive; 
and then defining x < y to mean x £ y and x *■ y, 

4. Logical notation 

Our logical notation and usage will be standard throughout. We 
use the word iff as an abbreviation for if and only if. The symbol = 

(JIM ii aa n-ary relation or predicate .Yfix) on » set -4 is idcnlitictl with the let 
> » x : A^ aitJM(x;holdtj. Wc donoiir.si*! rr this idcnHficalkti here, although 
i>tr exposition ii consistent with, this approach. 
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denotes definitional equivalence, while => denotes implies, and <=> 
denotes implies and is implied by. We use the symbols V, 3 to mean 'for 
all' and 'there exists' in the standard way. 
The symbol H is used in the text to indicate the end of a proof. 



5. References 

Each chapter is divided into sections, and items in each section 
are numbered consecutively. A reference such as theorem 5-1.4 means 
theorem 1.4 of chapter 5: this is the fourth numbered item of § 1 in that 
chapter. When referring within a chapter the number of the chapter is 
omitted. Exercises are included in this system of numbering. Thus 
exercise 6-1.8(2) means the second exercise of exercises 1.8. found in 
chapter 6. 

Reference to entries in (he bibliography is made by citing the author 
and year of publication of the work referred to. 






Computable functions 



We begin this chapter with <■ discussion of the fundamental idea of an 
algorithm or effective procedure. In subsequent sections we describe the 
way in which this idea can he made precise using a kind of idealised 
computer; this lays the foundation for a mathematical theory of compu- 
tability and computable functions. 



1. Algorithms, or effective procedures 

When taught arithmetic in junior school we all learnt to add and 
to multiply two numbers. We were not merely taught that any two 
numbers have a sum and a product - we were given methods or rules for 
finding sums and products. Such methods or rules are examples of 
algorithms or effective procedures. Their implementation requires no 
ingenuity or even intelligence beyond that needed to obey the teacher's 
instructions. 

More generally, an algorithm or effective procedure is a mechanical 
rule, or automatic method, or programme for performing some mathe- 
matical operation. Some more examples of operations tor which easy 
algorithms can be given are 

(1.1( (a) given n, finding the nth prime number, 

(b) differentiating a polynomial, 

(c) finding the highest common factor of two numbers {the 
Euclidean algorithm), 

(d) given two numbers ,v, y deciding whether x is a multiple of y. 

Algorithms can be represented informally as shown in fig. la. 
The input is the raw data or object on which the operation is to be 
performed (e.g. apolynomialfortl.l) (At, a pair of numbers for (1.1) (c) 
and (tf).) and the output is the result of the operation (e.g. for ''LIMA J. the 
derived polynomial, and for (LI) id), the answer yes or no). The output is 
produced mechanically by the black box - which could be thought of as a 
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Bla;k box 



«(«) = 



calculating machine, a computer, or a schoolboy correctly taughl-or 
even a very clever dog trained appropriately. The algorithm is the 
procedure or method that is carried out by the black box to obtain the 
output from the input. 

When an algorithm or effective procedure is used to calculate the 
values of a numerical function then the function in question is described 
by phrases such as effecticeh calculable, or algonthmicaliy computable, or 
effectively computable, or just computable. For instance, the functions xy, 
HCF(x, y} = the highest common Factor of x and y, and fin } = the r.ih 
prime number, are computable in this informal sense, as already 
indicated. Consider, on the other hand, the following function: 

1 if there is a run of exactly n consecutive 7s 
in the decimal expansion of ir, 

otherwise. 

Most mathematicians would accept that g is a perfectly legitimate 
function. But is g computable? There is a mechanical procedure for 
generating successive digits in the decimal expansion of it, 1 so the 
following 'procedure' for computing g suggests itself. 

'Given n, start generating the decimal expansion of v, one digit at a 
time, and watch for 7s. If at some stage a run of exactly n consecutive 7s 
has appeared, then stop the process and put gin} = 1. If no such sequence 
of 7s appears put g(rt) = GV 

The problem with this 'procedure' is that, if for a particular n there is no 
sequence of exactly n consecutive 7s, then there is no stage in the process 
where we can stop and conclude that this is the case. For all we know at 
any particular stage, such a sequence of 7s could appear in the part of the 
expansion of v that has not yet been examined. Thus the "procedure' will 
go on for ever for inputs n such that g{n\ = 0; so it is not an effective 
procedure. (It is conceivable that there is an effective procedure for 
computing g based, perhaps, on some theoretical properties of tr. At the 
present time, however, no such procedure is known.) 

' This will be cuabllshed ir. chapter 3 (example 7. 113)). 



£ i he uriitmirea register macmne v 

This example pinpoints two features implicit in the idea of an effective 
procedure - namely, that such a procedure is carried out in a sequence of 
stages or steps (each completed in a finite time), and that any output 
should emerge after a finite number of steps, i 

So far we have described informally the idea of an algorithm, or 
effective procedure, and the associated notion of computable function. 
These ideas must be made precise before they can become the basis for a 
mathematical theory of com put ability - and noM-computability. 

We shall make our definitions m terms of a simple 'idealised computer' 
that operates programs. Clearly, the procedures that can be carried out by 
a real computer are examples of effective procedures. Any particular real 
computer, however, is limited both in the size of the numbers that it can 
receive as input, and in the amount of working space available; it is in 
these respects that our 'computer' will be idealised in accordance with the 
informal idea of an algorithm. The programs for our machine will be 
finite, and we will require that a completed computation takes only a 
finite number of steps. Inputs and outputs will be restricted to natural 
numbers; this is not a significant restriction, since operations involving 
other kinds of object can be coded as operations on natural numbers. (We 
discuss this more fully in § 5.) 



2. The unlimited register machine 

Out mathematical idealisation of a computer is called an 
unlimited register machine (URM); it is a slight variation of a machine 
first conceived by Shepherdson & Sturgis [1963]. In this section we 
describe the URM and how it works; we begin to explore what it can do in 
§3. 

The URM has an infinite number of registers labelled R ( , R 2 , Ri, . . . , 
each of which at any moment of time contains a natural number; we 
denote the number contained in R., by r n . This can be represented as 
follows 



Rt 


R 2 


R3 


R, 


R 5 


R 6 


R, 




'i 


'2 


ri 


r* 


'5 


H 


r-> 





The contents of the registers may be altered by the URM in response to 
certain instructions that it can recognise. These instructions correspond to 
very simple operations used in performing calculations with numbers. A 
finite list of instructions constitutes a program. The instructions are of four 
kinds, as follows. 
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Zero instructions For each n = 1 , 2, 3, . . . there is a zero instruction 
Z(/i). The response .if the URM to the instruction Zin) is to change the 
contents of R„ to 0, leaving all other registers unaltered. 

Example Suppose that the URM is in the following 
configuration 

R, R ; R, Ra R. R* 










and obeys the zero instruction Z{3). Then the resulting configuration is 



{") 



i 23 







The response at the URM to a zero instruction Z(n ) is denoted by -» R* 
or r r '— (this is read r„ becomes 0). 

Successor instructions For each «- 1,2,3,..- there is a successor 
instruction S(w). The response of the URM to the instruction Sin! is to 
increase the number contained in R n by 1, leaving all other registers 
unaltered. 

Example Suppose that the URM is in the configuration £*) 
above and obeys the successor instruction Si.5 ). Then the new con- 
figuration is 

Ri Rj R-, R4 R5 R^ 



(**) 







23 



8 







The effect of a successor instruction Sin) is denoted by r„ + \ -» R„, or 
ft '■= r n + I (f n becomes r„ + 11. 

Transfer instructions For each m = 1, 2, 3, . . . and n — 1 , 2, 3, . . . there 
is a transfer instruction Tt,m, n>. The response of the URM to the 
instruction T(m, n) is to replace the contents of R„ by the number r„. 
contained in R m (i.e. transfer r.„ into R n |; all other registers (including 
R m ) are unaltered. 

Example Suppose that the URM is in the configuration (**) 
above and obeys the transfer instruction T(5, 1). Then the resulting 



configuration is 

Ri R2 



R, R 4 R 5 R-. 



s 







23 
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The response of the URM to a transfer instruction Tim, n) is denoted by 
r. n -* R„. or r„ :- r m (/„ becomes r m ). 

Jump instructions In the operation of an informal algorithm there may 
be a stage when alternative courses of action are prescribed, depending 
on the progress of the operation up to that stage . In other situations it may 
be necessary 10 repeat a given routine several times. The URM is able to 
reflect such procedures as these using jump instructions ; these will allow 
jumps backwards or forwards in ihe list oi instructions. We shall, for 
example, be able to use a jump instruction to produce the following 
response : 

if r 2 = r , go to the 1 0th instruction in the program ; otherwise, go 

on to the next instruction in the program.' 

The instruction eliciting this response will be written J(2, 6, 10). 

Generally, for each m = 1. 2. 3. .. . , n = 1, 2. 3, . . . and q = I, 2. 3, . . . 
there is a jump instruction Jim, n, q). The response of the URM to the 
instruction Jim. n,q) is as follows. Suppose that this instruction is 
encountered in a program P. The contents of R* and R.., arc compared- 
but all registers are left unaltered. Then 

if r m = r„, the URM proceeds to the qih instruction of P; 

if r„ * r„ the URM proceeds to the next instruction in P. 
If the jump is impossible because P has less than q instructions, then the 
URM stops operation. 

Zero, successor and transfer instructions are called arithmetic instruc- 
tions. 

We summarise the response of the URM to the four kinds of instruc- 
tion in table 1. 

Computations To perform a computation the URM must be provided 
with a program P and an initial confiRumnon - i.e. a sequenee 

fli.ai, a.i, ... of natural numbers in the registers R1.R2.Rfe 

Suppose that P consists of s instructions / : , J 2 , . . . . J,. The URM begins 
the computation by obeying /;, then h, h> and so on unless a jump 
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Table 1 



Zero 
Successor 

Transfer 

J.lfT.p 



Type ui instruction Instruction 



ZCwl 
S[n) 

T(m.n) 
Jim. n,q) 



Response of the URM 



Replace r„ by 0. (0 - R-, or r„ := 0) 
Add I to r„. {r H + 1 ■* R B , or r„ := r„ + 
1) 

Replace r„ by/„,.(r._ ■* R„. or r„ ~=r m ) 
If r m = r„ jump to the </th instruction; 
otherwise go on to the next instruc- 
tion in the program. 



instruction, say Jim, n, q), is encountered. In this case the URM proceeds 
to the instruction prescribed by Jim, n, q) and the current contents oF the 
registers R m and R„. We illustrate this with an example. 



2.1. Example 

Consider the following program: 

/. J<1,2,6) 

h Sl2i 

h S(3) 

U 1(1,2.6) 

h KM, 2) 

U 1*13.1) 

Let us consider the computation by the URM under this program with 
initial configuration 

K^ 1x2 "3 "* **" 



I) 











(We are not concerned at the moment about what function this program 
actually computes; we wish to illustrate the way in which the URM 
operates programs in a purely mechanical fashion without needing to 
understand the algorithm that is being carried out.) 

We can represent the progress of the compulation by writing down the 
successive configurations that occur, together with the next instruction to 
be obeyed at the completion of each stage. 



Rj R : Rj R a Rs 



Next instruction 



Initial 

eonfig- I 9 

u rat ion ' 



i I) 



9 , 7 



/ 2 vsince r, rf r 2 ) 



9 8 



h 



C 







1 



J 5 (since r t i* r?) 



h (since r, =n) 



. (We shall continue this computation later.) 



and so on 



We can describe the operation of the L'RM under a program P = 
[ u l 2 1 in general as follows. The URM starts by obeying instruc- 
tion /,. At any future stage in the computation, suppose that the URM is 
obeying instruction l h Then having done so it proceeds to the next 
instruction in the computation, defined as follows: 

if L is not a jump instruction, the next instruction is A+t; 

/.. if Ik*" Cm 



if /* = Jlw, n, q ) the next instruction is 



/i_i otherwise. 



where r m , r„ are the current contents of R„ and R„. 

The URM proceeds thus as long as possible: the computation stops 
when, and only when, there is no next instruction ; i.e. if the URM has just 
obeyed instruction h and the "next instruction in the computation' 
according to the above definition is /,. where o > s. This can happen in the 

following ways: 

(i) if k = s (.the last instruction in P has been obeyed) and /, is an 

arithmetic instruction, 

tii) if / fc =J(m. n,q), r„=r„ andq>j, 

(iii) if h =J\m, /!.<?), r m *r 9 and k=s. 
We say then that the computation stops after instruction h \ the final 

configuration is the sequence r, . r 2 , r 3 the contents of the registers at 

this stage. 
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Let us now continue the computation begun in example 2.1, 





Example 2.1 {continued* 
Rt R; R.' R-t R s 


Next instruction 




9 


8 1 








... /; 








9 


9 


1 








h 












9 


9 


2 
j 





U 












9 


9 


2 








h (since fi = rj) 


Final 

config- 
uration 




2 


9 


2 


II 





/ 7 : stop. 



This computation stops as indicated because there is no seventh 
instruction in the program. 



2.2. Exercise 

Carry out the computation under the program of example 2. 1 

with initial configuration 8, 4, 2, 0, 0, . . . 

The essence of a program and the progress of computations under it is 
often conveniently described informally using a flow diagram. For 
example, a flow diagram representing the program ot example 2. 1 is given 
in fig. 1/j. (We have indicated alongside the flow diagram the typical 
configuration of the registers at various stages in a computation. I Note the 
convention that tests or questions (corresponding to jump instructions) 
are placed in diamond shaped boxes. 

The translation of this flow diagram into the program of exercise 2.1 is 
almost self -explanatory. Notice that the backwards jump on answer 'No' 
to the second question i r v =r 2 T is achieved by the fifth instruction 
J(l, 1,2) which is an unconditional jump: we always have ri = r u so this 
instruction causes a jump to /; whenever it is encountered. 

When writing a program to perform a given procedure it is often 
helpful to write an informal flow diagram as an intermediate step: the 
translation of a flow diagram into a program is then usually routine. 
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Fie- lb. Flow diagram for the program of example 2.1. 
START 

Typical configuration 

R, R ; R, 






No 




r*-*2+l 


No 

4 


1 

i 


/■(> rj - 1 


< n 


•«vN 



Yes 



r,-K, 



STOP 



Alter * cycles round the ioop 
in thisprnpram* 



v+Jc 



z-k\ 



It j y-A: 



z+k yk z*k 



There are, of course, computations that never stop: for example, no 
computation under the simple program S(l>, Jll. 1.11 ever stops. 
Computation under this program is represented by the flow diagram in 
tig. 1 c. The jump instruction invariably causes the U RM to return, or loop 
back, to the instruction SO). 

There arc more sophisticated ways in which a computation may run for 
ever, but always this is caused essentially by the above kind of repetition 
or looping back in the execution of the program. 
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i » 



Fig. ic 



vr-\Ri 



'i + l 



2.3 Exercise 

Show that the computaiion under ihe program oi example 2.1 

with initial configuration 2, 3, 0, 0, 0. . . . never stops. 

The question oi deciding whether a particular computation eventually 
stops or not is one to which we will return later. 

Some notation will help us now in our discussion. Let a x , ai, a 3 , ... be 
an infinite sequence from N and let P be a program; we will write 

(i) Pfflu °3> °i* •■ • • * or * c com P utalion under P with initial 

configuration a\, fli, a 3 , . . . ; 

(ii) P{a u a2,a it .. .)i to mean that the computation 

P{a_, a 2 , a», - - - > eventually stops; 

liii) P(fli»flj, ay,. - )* to mean that the computation 

P[flu a 2 , a 3 . . . . ) never stops. 
In most initial configurations that we shall consider, all but finitely 
many of the a, will be 0- Thus the following notation is useful. Let 
at. a 2 , . . - . a, be a finite sequence of natural numbers; we write 

(iv'i Pia%. a 2 ,..., a n ) for the computation 

P{fl,,a 2 ,-..-am 0,0,0,...), 



Hence 



(vj P{a u a-i, . . . , a,)j means that P[a u a : , a n , 0, 0, 0. . . . )»; 

Plat, fl:. - - - . «Of means that P[a u at,..., a n , 0, 0, 0, . . . )f. 



«vi 



Often a computation that stops is said to converge, and one that never 
stops is said to diverge, 

3. URM-computable functions 

Suppose that /is a function from h n to ft (n s> 1); what does it 
mean to say that / is computable by the URM? It is natural to think in 
terms of computing a value fia,, ...,a n ) by means of a program P on 

initial configuration a u a 2 , . . . .a„,Q,0 That is, we consider 

computations of the form P(a u a 2 , aj. tf any such computation 



..- *^*»(»i 



stops, we need to have a single number that we can regard as the output or 
result of the computation; we make the convention that this is the number 
r, finally contained in R|. The final contents of the other registers can be 
regarded as rough work or jottings, that can be ignored once we have the 
desired result in Ri- 

Since a computation P[a i, . . . , a n ) may not stop, we can allow our 
definition of computability to apply to functions f from ft" to ft whose 
domain may not be all of V*; i.e. partial functions. We shall require that 
the relevant computations stop (and give the correct result!) precisely for 
inputs from the domain of /. Thus we make the following definitions. 

3.1 Definitions 

Let f be a partial function from W' to ft. 

la) Suppose that P is a program, and let ax, a 2 , . . • , a n , b € M. 

(i) The computation P{a x ,a 2 a H > converges to b d 

P(at, a 2 flnW and in the final configuration b is in R|. We 

write this Pia x , .... a K )ib\ 

(ii) P VRM-compules f if, for every a, , a n , b 

Pia u ...,a n )ib if and only if ia lt . . . .aJeDomi/) and 

f(a u a„) = b. (In particular, this means that P(a it ..., a,)J if 

and only if \a-_ a„*s Dom{/>.) 

(&) The function /' is URM-computable if there is a program that 

URM-computes /. 

The class of URM-computable functions is denoted by % and n-ary 
URM-computable functions by «„. From now on we will use the term 
computable to mean URM-computable, except in chapter 3 where other 
notions of computability are discussed. 

We now consider some easy examples of computable functions. 



3.2 Examples 
{a) x + y. 
We obtain x + y by adding 1 to x (using the successor instruction! v 
times. A program to compute x+y must begin on initial configuration 
x, y, 0, 0, 0, ... ; our program will keep adding 1 to r u using R 3 as a 
counter to keep a record of how many times r x is thus increased. A typical 
configuration during the computation is 
R, R 2 R 3 Ki R 5 











1 Computable function* 



is 



The program will be designed lo stop when k m y, leaving x + y in R t as 

required. 

The procedure we wish to embody in our program is represented by the 
flow diagram in fig. Id. A program thai achieves this is the following: 

h J(3,2,5> *--i 

h S(l) J 

h S(3) 

U Jd.l.D---' 
(The dotted arrow, which is not part of the program, is to indicate to the 
reader that the final instruction has the efiect of always jumping back to 
the first instruction.) Note that the stop has been achieved by a jump 
instruction to 'h' which does not exist. Thus, jc-t-y is computable. 

Fig. 1 J. Flow diagram for addition (example 3.2(a)). 
start 



STOP 






r,»f, + 1 










* :-* - 1 




<Ty= 


i+ll 



(h) 



x-rl = 



*-l ifx>0, 



ifx = 0. 

(Since wc are restricting ourselves to functions from fSi to H, this is the best 
approximation to the function x — 1.) 

We will write a program embodying the following procedure. Given 
initial configuration x, 0, 0, 0, ... , first check whether x = 0; if so. stop; 
otherwise, run two counters, containing k and fc+ 1, starting with k = 0. 
A typical configuration during a computation will be 
R, R : R; R„ 

x ft ft + 1 ... 



Check whether x ■ k + 1 ; if so, the required result is k ; otherwise increase 
both counters by 1, and check again. 

A flow diagram representing this procedure is given in fig. le. A 
program that carries out this procedure is the following: 

Ji J(l,4,9) 

h S(3J 

U J(*»3.7) * — i 

h S(2) ! 

h S(3) J 

h J(l,1.3) ' 

h T(2,l) 
Thus the Function x — 1 is computable. 



Fig. \e. Flow diagram f or x - I (example 3.2(b)). 



Typical configuration 
K, R. R, 








K 

No, 


I 


tr 3 :-r 3 » 1) 




" 




rj** Fj-i- J 






5Tf.ll" 



1= ,'H'lt 



(c) 



/(*) = 



fix 

\ undefined 



if :r is even. 

if x is odd. 



In this example. Dom(/) = E (the even natural numbers) so we must 
ensure that our program does not stop on odd inputs. 

A procedure for computing fix) is as follows. Run two counters, 
containing ft and 2ft for ft ■ 0, 1, 2, 3, ... : for successive values of k, 
check whether x = 2ft; if so, the answer is ft; otherwise increase ft by one, 
and repeat. If x is odd, this procedure will clearly continue for ever. 

The typical configuration will be 

K^ Jv; 1x3 K4 



i.'t*jvi~tam(iuiaiiie tunciit/nt 



£1 



2ft 



i) 






with ft = initially. A flow diagram for the above process is given in fig. 1/. 



Fig. If. Flow diagram for example 3.2(c)). 



START 




STOI 



A program that executes it is 
l\ JO. 2.6) 
h S(3) 
h S(2) 
h S(2) 
h 7(1,1.1) 

h T(3.1) 
Hence f is computable. 

Note. The programs in these examples are in no sense the only programs 
that will compute the functions in question. 

Given any program P (i.e. any finite list of instructions), and n s I, by 
thinking of the effect of P on initial configurations of the form 
flu a 2 , - . . , a„, 0, 0, . . . we see thai there is a unique /i-ary function that P 
computes, denoted by /£'. From the definition it is clear that 

(the unique b such that P(a |. . . . , a,. J J b, 
fe' [a\, . . . , a a ) = I ifffa, ... . ,«*)*; 

(undefined, if P{a,, .... a,)". 

In a later chapter we shall consider the problem of determining ff for 
any given program P. 

It is clear that a particular computable function can be computed by 
many different programs; for instance, any program can be altered by 
adding instructions that have no effect. Less trivially, there may be 
different informal methods for calculating a particular function, and when 
formalised as programs these would give different programs for the same 
function. In terms of the notation we have introduced, we can have 
different programs P\ and Pi, with f$ t ' = fe, for some (or all) it. Later we 
shall consider the problem of deciding whether or not two programs 
compute the same functions. 

3.3 Exercises 

1. Show that the following functions arc computable by devising 
programs that will compute them. 

, . -. (0 ifx = 0, 
(*)/<*)- 5; 



w*^e::;5 



/ t^omputawe functions 



£.£. 



[0 if 
«*^il if 

U)/U)- 



ifxsy. 
x>y, 
\\x if x is a multiple of 3, 
'undefined otherwise; 
(/) f(x) = [2x/$l (|z | denotes the greatest integer *z). 

2. Let P be the program in example 2.1. What is fp'l 

3. Suppose that P is a program without any jump instructions. Show 
that there is a number m such that either 

fp\x) = m, for all x, 

or 

fp{x) — x — m t for all x. 

4. Show that for each transfer instruction T\m, n) there is a pro- 
gram without any transfer instructions that has exactly the same 
effect as T[m,n) on any configuration of the URM. iThus 
transfer instructions are really redundant in the formulation of 
our URM; it is nevertheless natural and convenient to have 
transfer as a basic facility of the URM.) 



4. Decidable predicates and problems 

In mathematics a common task is to decide whether numbers 
possess a given property. For instance, the task described in (1.1) Id) is to 
decide, given numbers x, y, whether they have the property that x is a 
multiple of y. An algorithm foT this operation would be an effective 
procedure that on inputs x, y gives output Yes or No. If we adopt the 
convention that 1 means Yes, and means No. then the operation 
amounts to calculation of the function 

1 if x is a multiple of y, 

if x is not a multiple of y. 

Thus we can say that the property or predicate 'x is a multiple of y' is 
algohthmically or effectively decidable, or just decidable it this function f 
is computable. 

Generally, suppose that M{xiiX2f-T*n) is an /t-ary predicate of 
natural numbers. The characteristic function c M yx) (setting x = 
(Xi„ ■■-*«)) iS given by 

1 if Xfixt holds: 



/U,y) = 



c M (x) = 






if Mix) doesn't hold. 



4.1 Definition 

The predicate Mix) is decidable if the function Cm is compu- 
table; Mix) is undecidable if Mix) is not decidable. 



«-e I 



4.2 Examples 

The following predicates are decidable: 

{a) 'x^y': the function/of exercise 3.3 (lc t is the characteristic 

function of this predicate. 

(b) 'x = 0': the characteristic function is given by 

ifx = 0. 
if jr f^ 0. 

The following simple program computes g: 

J<1,2,3) 

J(l.l,4) 

S(2) 

T(2, 1) 

(c) 'x is a multiple of y ' : it is possible to write a program for the 
characteristic function, but this would be somewhat lengthy and 
complicated. A simpler demonstration that this predicate is 
decidable will emerge from the next chapter, where techniques 
for generating more complex computable functions are 
developed. 

Note that when discussing decidability (or undecid ability) wc are 
always concerned with the eomputability lor non-computability) of total 

functions. 

In the context of decidability, properties or predicates are sometimes 
described as problems. Thus we might say that the problem 'x * y' is 
decidable. In chapter 6 we will study undecidable problems. 



4.3 Exercise 

Show that the following predicates are decidable. 

la) *x<y\ 

0) -x*r, 

(c) 'x is even*. 

5. ComputabflHy on other domains 

Since the URM handles only natural numbers, our definition of 
eomputability and decidability applies only to functions and predicates 
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of natural numbers. Those notions are easily extended to other kinds of 
Mlows 6 '*' ' n,e * erS ' P ° lyn0mia,S - matrices - «*> ^ ">«■» »f coding, as 

A coding of a domain O of objects is an explicit and effective injection 
« D-*l. We say that an object ^Di s coded by the natural number 

"In Hi UP T e , " OW ,ha ' f " ' ' UnC,i0n fr ° m ° ,0 ° ; < hea f » """ally 
cofled by the funcfon ,"* from N to * that maps .he code of an object 

d c Domi to the code of «d). Explicitly we have 

Now we may extend the definition of URM-computability ft, J> by saying 
that/,s c^uM, if/- !s a computable function of natural numbers 

5.1 Example 

Consider the domain Z. An explicit coding i s given by the 
Junction a where 

l-2«-l if^<0. 
Then <a~ is given by 

a^ lm ) = { f m if mis even, 

1-&W + 1) ifm is odd. 

Consider now the funct.on x-lonl; if we call this function /. then 
/ ;N-* \is given by 

fl if x = (i.e. x = (r(0», 

/*(*) =jx -2 if * > and x is even (U. * = <*(«), n > fl), 

U+2 if* is odd. (i.e.x = a(n),fl<0). 
It is a routine exercise to write a program that computes f* ; hence x -1 fa 
a computable function on Z. 

The definitions of computable *-ary function on a domain D and 
a^ve^dL^ °" ° arC ° b,ainCd b> ' lhe 0bV10US eX ' CnSi0n " the 



5.2 Exercises 

1 . Show that the function 2x on 2 is computable. 

2. Show that the predicate 'x afj' k a deeidable predicate on Z. 



Generating computable 
functions 



In this chapter we shall see that various methods of combining compu- 
table functions give rise to other computable functions. This will enable 
us to show quite rapidly that many commonly occurring functions arc 
computable, without writing a program each time -a task that would be 
rather laborious and tedious, 



I . The basic functions 

First we note that some particularly simple functions are 
computable; from these basic functions {defined in lemma 1.1 below) we 
shall then build more complicated computable functions using the tech- 
niques developed in subsequent sections. 



1.1. Lemma 

The following basic functions are computable : 

(a) the zero function 0(01*) = for all x); 

(b) the successor function x + 1; 

(c) for each <i£l and 1 £ i ' ^ n, the projection function U" given 
byU?ix u x 2 x n ) = x. 

Proof. These functions correspond to the arithmetic instructions for 
the URM. Specifically, programs are as follows: 
(a) 0: program Z(l>; 
lb) x + l: program S(l); 
(c) V": program T{f, 1). O 



2. Joining programs together 

In each of §§ 3-5 below we need to write programs that 
incorporate other programs as subprograms or subroutines. In this section 
we deal with some technical matters so as to make the program writing of 
later sections as straightforward as possible. * 



A simple example of program building is when we have programs P 
and Q, and we wish to write a program for the composite procedure; first 
do P. and then do O. Our instinct is to simply write down the instructions 
in P followed by the instructions in Q. But there are two technical points 
lo consider. 

Suppose that P = I u /;,... , /,. A computation under P is completed 
when the "next instruction for the computation' is /, for some v >s: we 
then require the computation under our composite program to proceed 
to the first instruction of Q. This will happen automatically if v = s + 1 , but 
not otherwise. Thus for building composite programs we must confine our 
attention to programs that invariably stop because the next instruction is 
4+1- Such programs are said to be in standard form. Clearly it is only jump 
instructions that can cause a program to stop in non-standard fashion. 
Thus we have the following definition. 

2.1. Definition 

A program P = /,. I 2 , . . . , /, is in standard form if, for every 
jump instruction Mm.n.q) in/* we have flffij + 1. 

Examples. In examples 1-3.2 the programs for ia) and Ic) are in 
standard form, whereas the program in ib) is not. 

Insisting tin standard form if necessary is no restriction, as we now see. 



2.2. Lemma 

For any program P there is a program P" in standard form such 
that any computation under P* is identical to the corresponding compu- 
tation under P, except possibly in the manner of stopping. In particular, for 
anya l ,...,a fP> b, 

P{a u ... t a n )ibifandonlyifP*{a u ...,a*)lb, 
and hence fp* = /if- for every n >0. 

Proof. Suppose that P = /,, t z , & To obtain P* from P simply 

change the jump instructions so that all jump stops occur because the 
jump isto/.-i. Explicitly, put P* = If, /f, ..., I* where 

if I k is not a jump instruction, then It = h ', 

if A-Jlm^Mhen /*-ff* _ JJ*^*tI' 

Uim,*i.j + lj if fl>j-l. 

Then clearly P* is as required. D 



^ joining programs wttemer - * 

Let us assume now Ihat the programs P and Q are in standard lorm. 
The second problem when joining P and O concerns the jump instruc- 
tions in Q. A jump Mm, n. q) occurring in Q commands a jump to the qih 
instruction of O (if r„ = r H ), But the qth instruction of Q will become the 
s + ifth instruction in the composite program; thus each jump Slm,n, if) in 
Q must be modified to become Mm, n, s 4 q) in the composite program if 

the sense is to be preserved. 
Now without any further worry we can define the join or concatenation 

of two programs in standard form: 



2.3. Definition 

Let P and O be programs of lengths s, t respectively, in standard 

p 
form. The join or concatenation of P and 0. written PQ or , is the 

program /- i% / 2 , ...,/„/,_:... ,/,,, where P = /|,...,/„ and the 
instructions £.1, ...,J»+ ( are the instructions of Q with each jump 
\(m, n.q) replaced by Jim, n, s + q). 



With this definition it is clear that the effect of PQ is as desired: any : 
computation under PQ is identical to the corresponding computation 
under P followed by the computation under Q whose initial configuration 
is the final configuration from the computation under P. 

There are two further considerations before we can proceed to the 
major tasks of this chapter. Suppose that we wish to compose a program 
Q having a given program P as a subroutine. To write O it is often 
important to be able to find some registers that are unaffected by 
computations under P. This can be done as follows. 

Since P is finite, there is a smallest number u such that none of the 
registers R,. for v > u is mentioned in P\ i.e. if Z(/i J, or S(« ), or T(m, n !, 
or Jim, n, q) is an instruction in P. then m.n^u. Clearly, during any 
computation under P, the contents of R, for v > u remain unaltered, and 
have no effect on the values of n, . . . , r„ Thus when writing our new 
program Q the registers R„ for v > u can be used, for example, to store 
information without affecting any computation under the subroutine P. 
We denote the number u by plP). 

Finally, we introduce some notation that will greatly simplify the main 
proofs of this chapter. Suppose that P is a program in standard form 
designed to compute a function fi.Xi, .... x„). Often when using P as a 



subroutine in a larger program the inputs x t , ...,x„ for which 
f(xt,.. . ,x„) is desired may beheld in registers R !r . . . , R^ rather than 

Ri R- as the program P requires: further, the output /{x, x,.\ 

may be required for future purposes to be in some register R, rather than 

the conventional R ; : and finally the working registers R, , R,,,., for P 

may contain alt kinds of unwanted information. We can modify P to take 
account of all of these points as follows. 
We write P[! u ...,/„-»/] for the program in fig. 2a that translates the 

flow diagram alongside. The program P[i- /„-*/] has the effect of 

computing /(/■-,, . . . , r^f and placing the result in R,. Moreover, the only 

registers affected by this program are (at mosi) R,, R z R pii >, and R». 

(We have assumed in defining P[l : /„-*/] that R,,, . . . , R,_ arc 

distinct from R , R„; this will be the case in all our uses of this 

notation. The reader should be able to modify the definition for situations 
where this is nol the case..) 



Fig. 2a. Flow diagram for P[l h 
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3. Substitution 

A common way of manufacturing new functions irom old is to 
substitute functions into other functions, otherwise known as composi- 
tion of functions. In the following theorem we show that when this 
process is applied to computable functions, the resulting functions are 
also computable. In short, we say that %' is closed under the operation of 
substitution. 



3.1. Theorem 

Suppose thai flyi,. . . , y;) and g\ix) gk(x) are computable 

functions, where x = Ui, . . . , x*)> Then the function hix) given by 

hKxi^fig,(x),...,Sk(x)) 
is computable. 

{Note. h{x) is defined if and only if giix),. . . , gkix) are all defined and 
igi(x). .. .,£*U)> = Dom(/'); thus, if f and gi, ..-,£* are all total 
functions, then h is total.) 

Proof Suppose that F, Ox. . . . , G* are programs in standard form 
which compute f.gi...., gk respectively. We will write a program H 
that embodies the following natural procedure for computing h, 'Given 
x, use the programs Gi, .... G* la compute in succession 
£iW> giix), . . . , gk{x), making a note of these values as they arc 
obtained. Then use the program F to compute /(gi {x\ &, U.H.* 

We must take a little care to avoid losing information needed at later 
stages in the procedure, namely x and those values gttx) already 

obtained. Putting m = maxU, k, o(F).p(Gi) ,p{G k )}, we shall begin 

by storing x in R M *u. . . ,R„,.,,;the registers R M +n+it* « tR-r-t »'iH 
be used to store the values g t {x) as they are computed for i = 1, 2, .... k. 
These registers are completely ignored by computations under 
F. Gi, .... G;. A typical configuration during computation under H will 
be 



Storage registers 



R| . . . R*, Rq-tl i • < K m - n K m -n*l K,n- n *> . ■ . K, B * n . 



G 



gi(*» 



fllfj 



giiX) 



An informal flow diagram for computing h is given in fig. 2b. This is 
easily translated into the following program H that computes hi 



'.it 'ir lanriff LL'ffij'iddi'i 'ii':. if ■(. 



-» OilV2iUiiir'"i 



JI 



T<l,m + 1) 

Tin, m + n) 

G;[m + 1, m->-2, . . . , m + n ~*m +n + 1] 

Gt\m — 1, m +2, . . ,m+n-*m-*-n — &] 
F[m-«+ I »i+«+Jk- 1] 



(Recall the meaning 
of this notation from 
§2.) 



Clearly a computation Hyx) will stop if and only if each computation 
Giix) stops (Isi'sA) and the computation F(ffi(*), . . . , fftCr)) stops, 
which is exactly as required. Q 

New functions can be obtained from any given function by rearranging 
or identifying its variables, or by adding new dummy variables; for 
instance, from a function /(y ( , yVi we can obtain 

h\[Xu Xi) — f{x<i, X\) (rearrangement*, 
hz[x i — /(x,x) (identification), 

">Ui.Xj. *j) as /(*li Xi) I adding dummy variables). 



Fig. 2ft. Substitution (theorem 3.1| 



The following application of theorem 3.1 shows that any of these opera- 
tions lor a combination of them) transforms computable functions into 
computable functions. 



START 



Store 


xin R m ,,. . 


• R-.... 
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g,tx)-R mrm „ 





1 



3.2. Theorem 

Suppose that f{y, y*} is a computable (unction and thai 

Xj P x,„ . . . ,x, k is a sequence ofk of the variables Xu... t x m (possibly with 
repetitions). Then the function h given by 

h(x l ,...,x„)^fix i „...,x:,) 

is computable. 
Proof, Writing x — *.X\, . . . ,x n t we have that 

fe(jr)-/(U? l t*), UJW Vifye)) 

which is computable, by Lemma l.Uc) and theorem 3.1. D 
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Using this result we can see that theorem 3.1 also holds when the 
functions g, , . . . , g k substituted into f are not necessarily functions of all 
of the variables x-i j:,. as in the following example. 



3.3. Example 

The function /(x i, xa, Xs) — xi 4*I4+Xs 'S computable; this can be 
deduced from the fact that x + y is computable {example 1-3. 2(a)), by 
substituting X\ +xi tot x, and Xj for y in x + y. 



£ t-ientrruang ct/mpuiauie luncimnx 



Substitution combined with ihe principle described in the next section 
gives a powerful method of generating computable functions. 



3.4. Exercises 

1 . Without writing any programs, show that for every m = K the 
following functions are computable: 

(a) m (recall that mU) = m, for all x), 
\b) mx. 

2. Suppose that f{x, y) is computable, and m erw. Show that the 
function 

hi x)^ fix, m) 

is computable. 

3. Suppose that g(jt) is a total computable function. Show that the 
predicate M{x, y) given by 

M(x,y) = -g{x) = y' 

is deddable, 



4. Recursion 

Recursion is a method of defining a function by specifying each of 
its values in terms of previously defined values, and possibly using other 
already defined functions. 

To be precise, suppose that fix) and g(x,y t z) are functions (not 
necessarily total or computable). Consider the following 'definition' of a 
new junction h(x, y): 

(4.1) (i) h(x,0) =/<*». 

(ii) h(x.y + l)=*glx,y.h{x,y)). 

At first sight this may seem a little dubious as a definition, for in the 
second line it appears that h is being defined in terms of itself - a circular 
definition! However, with a little thought we can convince ourselves that 
this is a valid definition ; to find the value of h ix, 3) for instance, first find 
h{x, 0) using {4.1 Hi); then, knowing h (jc, 0). use (4. l)(h) to obtain hix, 1): 
similarly, obtain h{x, 2), and finally h\x, 3 1 by further applications of 
(4.1KB). Thus, circularity is avoided by thinking of the values of hix, y) as 
being defined one at a time, always in terms of a value already obtained. 



A function h defined thus is said to be defined by recursion from the 
functions / and g; the equations 4.1 are known as recursion equations. 
Unless both/ and g are total, then h as defined by (4.1) may not be total; 
the domain of h will satisfy the conditions 

(xO)EDom{*) iff x€Domiy>, 

U. y - 1) s Domirt) iff ix, y) e Dom{A) 

and ix, y, hix, y))EDom(^>. 

Let us summarise the above discussion in a theorem, whose proof we 
omit. 

4.2. Theorem 

Lei x = ix u ...,x H ), and suppose that fix) and g{x,y,z) are 
functions: then there is a unique function h ix, y) satisfying the recursion 
equations 

fc(*vO)=*/(*). 

h{x, y + 1) = ff(>, y, hix, y)). 
Note. When n ~ (i.e. the parameters x do not appear \ the recursion 
equations take the form 

h(0) = a, 

hiy-U^giy.hiy)), 
where a € foJ. 



4.3. Examples 

\a ) Addition: for any x, y we have 

x+G = x, 

x+(y + l) = (..t + y)+l. 
Thus addition (i.e. the function k(x, }) = x + y) is defined by recursion 
from the functions fix) = x and gix, y, z ) = z + 1. 

{h\ y !: with the convention that 0!= 1, we have that 

0!=1, 

(y + U! = y!(y + l>. 
Thus the function y! is defined by recursion from 1 and the function 
g(y,z| = z(y + l). 

There are forms of definition by recursion that are more general than 
the one we have discussed; we shall encounter an example of this in § 5. 
and a fuller discussion of this topic is included in chapter 10. In contexts 



where general kinds of recursion arc being considered, the particularly 
simple kind of definition given by (4,1) is called primitive recursion. 

Many commonly occurring functions have easy definitions by (primi- 
tive) recursion, so for establishing compufcibtlity the next theorem is 
extremely useful. Briefly, it shows that % is closed under definition by 
recursion. 



4.4. Theorem 

Suppose thai fix) and glx, y, *) are computable functions, where 
x = ix u . . . ,XnK then the function h{x*y) obtained from f and g by 
recursion is computable. 

Proof. Let F and O be programs in standard form which compute the 
functions fix Kind £ix, y. z). We will devise a program H for the function 
kix, y) given by the recursion equations 4.1. Given an initial configura- 
tion xi,... f x w y,0,O 1 0... H will first compute AU.U) (using F); 
then, if y^O, H will use G to compute successively kix. 1), 
hix. 2) . h(x, y), and then stop. 

Let m — max(n f 2, plF ),p[0)}\ we begin by storing x, y in 
R„.i. .... R,,,, : . : ; the next two registers will be used to store the current 
value of the numbers k and h |x. k ) for k = 0. 1 , 2, . . . , y . Writing f for 
m + n< a typical configuration during the procedure will thus be 

Storage registers 



Rl . . . R,„ R,,^! . . . R; R;. 



"■'•; *v-3 



(*> 



h{x, k) 



with ft =(1 initially. 

An informal flow diagram for the procedure is given in fig. 2c. This flow 
diagram translates easily into the following program H that computes h : 

T'l.m+1) 

T(n + 1 , m - 'J - 1 ) 
F[\,2,. ..,>>->: + ?>] 

G\m + \,..,m + n,t + 2. t + 3->t + 3] 
5(f+2) 

3{l,Uq) 

U T(r + 3, 1} 

Hence h is computable. ~1 



■* K?c«rsa*'i 



Fir, 2c. Recursion ( theorem 4.4). 
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confirmation is(»() 
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No 
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Co-R.l 






gix l k,k(x,k))-*R.. i 
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S l"Of 



We now proceed to use theorems 3. 1 and 4.4 to compile a collection of 
computable functions. The collection is potentially infinite, so our choice 
is influenced by (i) the needs of subsequent development of our theory, 
and (ii) the desire lo give credence to the thesis that all functions that we 
would regard as computable in the informal sense are indeed URM- 
computablc. For reasons which will become apparent later we shall 
include some functions such as x + y and x — 1 for which we have already 
written programs. 

We shall use repeatedly the fact that .by theorem 3.2, in a definition by 
recursion sueh as (4.1), the computable functions f and a need not 
be functions of all of the named variables for the function h to be 
computable. 



£ Crene ratin ,f compittaoie functions 



JO 



4.5. Theorem 

The following functions are computable. (Proofs arc given as the 
functions arc listed.) 

(a) x + y Proof Example 4.3(a) gives a definition by recursion 

from the computable functions x and r +1. 

(b) xy Proof. x0 = 0, 

x{y + l) = xy + x. 
is a definition by recursion from the computable 
functions 0(x) and z + x. 
ic) x y Proof x n =l, 

x y = x r x; by recursion and \b), 
(d) x-i Proof 0-1 = 0, 

(x + 1J— 1 ~= x\ by recursion. 



(e) x 



-={; 



m **-g j 



(cf. exercises 1-3.3(U3) 



x-y ifx^y, , _ , ,. , 
, . Kcut-off subtractions 
otherwise. 

Proof x-0 = x, 

x — (y + l) = tx — y) — 1; by recursion and (d), 

ifx = 0, 

m X3*Q. 

' Proof sg(0) = 0, 

sg(x + 1 } = 1 ; by recursion. 

Kg) sg(x) = j '/" ' Ecf. example 1-4.2(6)) 

10 I,'X 5*0. 

Proof sg(x l = 1 — sg(x); by substitution, (ej and (/). 
COlx-y /Voo/. k-y| = {x — y.l + iy — x): by substitution, 

(dl and te), 
U) xl Proof. Example 4.3(A) gives a definition by recursion 

from computable functions. 
(/) minU. y) = minimum of x and y. 

Proof. min(x, y) = x — \x — y); by substitution. 
Ik) maxf.x, y) = maximum of x and y. 

Proof raaxt.x, y ) = x + (y — x); by substitution. 
(r ) rm(x, y ) = remainder when y is divided by x {to obtain a total 
function, we adopt the convention rm(fl, y) = y). 

Proof We have 

rm(x, y)+l if rmlx, yj+l^x, 
ifrmU. y)+l =x. 

This gives the following definition by recursion: 

rmU,0) = 0, 

rmlx, y - 1) = (rm|>, y)+ 1) sg( x - (rmlx, y) + 1)|). 



rm(x 



.,+«-(, 



The second equation can be written 

rmu, y + 1) — glx.rmix, >■)) 

where g[x, z'\ = (z + l)sgl|x-U--l>|); and g is 

computable by several applications of substitution. 

Hence rmlx, y) is computable, 
(m.iqiix, y) = quotient when y is divided by x {to obtain a total 
function we define qt(0. y » = 0). 

Proof. Since 

*qt(x, y)+l ifrm(x, y) + l = x, 
.qtU. y) if rm<x, y ) + 1 * x, 

we have the following definition by recursion from 

computable functions: 

qtU, 0) = 0, 

qt(x,y+ li=qt(x,y!+sgiix-irmu.y) + l)|). 

1 if x y (x divides y ), 



qllx, y + l) = 



in) div(x.y) = 

II ifx/y. 

i We adopt the convention that but X y if y £ 0.) Hence 

x\y is decidable (recall definition l-4.lt. 

Proof. div(x. yl = sg(rm(x, > ■)). computable by substi- 
tution, n 



The following are useful corollaries involving decidable predicates. 

4.6. Corollary (Definition by cases} 

Suppose thatf\{x) &(*) are total computable functions, and 

Myix), .... M k lx) are decidable predicates, such that for every x exactly 
one of M\{x), . . ..M*ix) holds. Then the function gix) pven by 
A U.i if MAx) holds, 
, xt = ,hl x > if M 2 {x) holds, 

\j\ix) if M k (x) holds, 

is computable. 

Proof glx't = c Mt (x)f t (x) + - - . + c Mk ix)f t (x), computable by substitu- 
tion using addition and multiplication. Z2 



4.7. Corollary (Algebra of decidability) 

Suppose that Mix) and Q{x) are decidable predicates; then the 
following are also decidable. 

{a) 'not Mix)' 



= » — ' *™ 

(b) , M{x)andCHxy 

(c) 'M(x) orQixy 

Proof. The characteristic functions of these predicates arc as follows: 

(a) 'not Afdl': 1 -c M (x). 

lb) -Mix) and QixV: <;«(*) c (x), 

tc) 'Mix) or (?(*)': max(c u (i), cq{*)) (where we take 'or' in the 

inclusive sense;. 
Each of the functions on the right is computable provided Cm and Co are, 
by substitution in functions from theorem 4.5. D 



Recursion can be used to establish the computability of functions 
obtained by other function building techniques, which we now describe. 
First, we introduce some notation. 

Suppose that /(x, z ) is any function; the bounded sum X r<v /{x, z) and 
the hounded product [\ :<v fix, z) are the functions of x, y given by the 
following recursion equations. 



(4.8) 



I fix,z) = 0. 



I<D 



1 fix.zi= E /i>,2l-/lx,y), 



(4.9) 



n/c*,z>=i. 



: <ra 






4.10. Theorem 

Suppose ttiatflx.z) is a total computable function; then the 
function* y e ^ y fix, z) and U*<yf(*,*) are computable. 

Proof. The equations 4.8 and 4.9 are definitions by recursion from 
computable functions. □ 



It is easily -seen that if the bound on : in a bounded sum or product is 
given by any computable function, the result is still computable, as 
follows. 



4.11. Corollary 

Suppose that fix, z) and kix. w) are iota! computable functions; 
then so are the functions )L 1<klK ^,flx y z) and W^^Jyx.z) [both 
functions of x. *'). 



Proof. By substitution of k (x. w) for y in the bounded sum V , <t f(x, z) 
and the bounded product | \ 1<y f\x, z). C 

We now describe another useful function building technique which 
yields computable functions. We write 

fiz<y(. ..) 
for 'the least z less than y such that .... In order that this expression be 
totally defined, we give it the value y when no such z exists. Then, for 
example, given a function fix, z ) we can define a new function g by 
Z(x,y) = nz<y(fix,z) = 0) 

the least z < y such that f{x, z) = 0, if such a z exists, 
y if there is no such z. 

The operator fxz<y is called a hounded minimalisation operator, or 
bounded p-operator. 



4.12. Theorem 

Suppose thai fix, y) is a total computable function: then so is the 
fun ction fiz<y (f(x, z ) = 0) . 
Proof. Consider the function 

h(X,V)= Sg(/U>M», 

US.'' 

which is computable by corollary 4.11. For a given x, y, suppose that 
z = fiz<y(f{x, z)-0). It is easy to see that 

if v <Zo, then hix, u) = l; 

if zt, Sb< y, then h [x, v) = 0. 
Thus 

2 U = the number of i* less than y such that A Ix. c) = 1 , 

= I h(x,v). 

Hence 

pz<y{f{x,z) = 0] = V ( fl sgf/U.u))). 

and is computable by theorem 4. 1 1). D 



As with bounded sums and products, the bound in bounded mini- 
malisation can be given by any computable function: 



iKt'CUr.liO': 



4.13. Corollary 

If fix, z } and k (x, w I are total computable functions, then so is the 
function 

nz<ktx,w)(f{x,z) = 0). 

Proof. By substitution of k[x,w) for y in the computable function 
nz<y{f{x,z) = 0). D 

Theorems 4.10 and 4.12 give us the following applications involving 
decidable predicates. 

4.14. Corollary 

Suppose that Rix.yi ts a decidable predicate: then 
(a) the function fix, y) = u-z<yRix, z) is computable, 
ib) the following predicates are decidable: 

(i) M- l {x,y) = Vz<yRix,z), 

(ii) ,\f 2 (x,y) = Sz<yR{x.z). 
Proof, 
{a) fix, y) = a.z< y(s~g(c ff (j. z)) = 0). 
fft) (i) c M ,ix,y) = \[, <t CR{x,z). 

(ii) A/ 2 (x, y) = not IV2 <y (not /?(>, 2))) 
which is decidable by ib)ti) and 4. 7 (a 1. C 

Note. As in 4. 11 and 4.13, the bound on 2 in this corollary could be any 
total computable function. 

We now use the above techniques to enlarge our collection of parti- 
cular computable functions and decidable properties. 

4.15. Theorem 

The following functions are computable. 

la) Dix) = the number of divisors of x (convention: D(0)=1), 

1(1 if x is not prime 
{i.e. l x is prime' is decidable). 

(c) p, = the x\\\ prime number [as a convention wesetpc = i\ then 
pi = 2, p 2 = 3, etc.) 

(the exponent of p r in the prime factorisation of x, for 

(<f)U)„ = ***>*> 



i/x = 0ory = 0. 



L 



Proof 

(a) DU;i-Z ra ..div(y. x ) (where div is as in theorem 4.5(n)>. 

1 if Du ) - 2 (i.e. x > 1 and the only divisors of x 
ib) PrU)= are 1 and*), 
otherwise 
= sg(|D<»-2|>. 
(C) Prt = 0, 

p > _, = ^r^(p,! + l)lr>p I and 2 is prime), 
which is a definition by recursion; the predicate 'z > y and z is 
prime' is decidable, <wi using corollary 4. 14 (and the note follow- 
ing) we have a computable function. 

(d) ix) r = pz<x[p 1 ,* 1 'x), which is computable since the pre- 
dicate , pj"-r*' is decidable. Z2 

Note. The function (x)« is needed in the following kind of situation. A 

sequence s = (a u a' 2 ,a% a n ) from X can be coded by the single 

number/) = pi'*'p2 : *' • ■ .p"""; then the length n of s and the number* 
a, can be recovered effectively from b as follows: 

n=tiz<H(b) t + 1 =0), 
a, = {b). - I for is/ <n. 
Alternative ways of coding pairs and sequences are indicated in 
exercises 4.16 (2, 5) below. 

4.16. Exercises 

1 . Show that the following functions are computable: 

(a) Any polynomial function a n + a\X +. . .*a n x\ where 
flo, ill, . . . , a* £\, 



lo) 



\x 



1. 



(c) LCM(x, y] = the least common multiple of x and y, 

{d) HCFix, y J = the highest common factor of x and y, 

le) fix) - number of prime divisors of x, 

if) <*>{x) = the number of positive integers less than x which are 

relatively prime to x. {Euier's function) (We say that x, y arc 

relatively prime if HCFU, y J — 1.) 

2. Let irix, y) = 2*(2y + l)-l. Show that tt is a computable bijec- 
tion from f*d" to ftJ, and that the functions ffi, ^2 such that 
r(irnz), ir 2 (2)) = r for all 2 are computable. 

3. Suppose f{x) is defined by 

A0) = i. 



'•■■. II '-*** > 



/(II-l, 

(fix) is the Fibonacci sequence.) 

Show that f is computable. [Him; first show that the function 

g{x) = 2"''3' ' is computable, using recursion.} 

4. Show that the following problems are decidable: 

(a) x is odd, 

</>) x is a power of a prime number, 
(c) a* is a perfect cube. 

5. Any number a r \ has a unique expression as 

(0 x = £/„„ Qr-2', with <», =0or 1, all L Hence, if x > 0, there are 
unique expressions for x in the forms 

(2) x =2 fc '+2**+- . . .+ 2*', with Q-sfr, < b 2 < . ■ .<*j and /=* 1. 
and 

(3) x = 2 a, +2 fll+%+ *-,..+2' , '*^"- +fl »"* \ 
Putting 

a((,.cl = i», as in the expression (1); 
f/asin!2), ifi>0, 

'fl otherwise; 

[ b„ as in (2), if x >0 and 1 < / =£ f, 

'0 otherwise; 

fa,, as in (3). if x > and 1 £ i s /. 

10 otherwise; 

show that each of the functions a. i, b, a is computable. iThe 
expression (3) is a way of regarding x as coding the sequence 
(a i, as, .... a- J oF numbers, and will be used in chapter 5.) 

S. Minimalisation 

In the previous section we have seen that a large collection of 
functions can be shown to be computable using the operations of substi- 
tution and recursion, and operations derived from these. There is a third 
important operation which generates further computable functions, 
namely unbounded minima lisanon, or just minimali\ation, which we now 
describe. 

Suppose thai/tr, y) is a function i.noi necessarily total) and we wish to 
define a function g{x) by 

gtxl = the least v such that /{x, yJ^O, 



,t;(iM"in»v.'.'i.ii 



in such a way that if /is computable then so is if. Two problems can arise 
First, for some x there may not be any v such that f\x, y)- 0. Second. 
assuming that / is computable, consider the following natural algorithm 
for computing g(x ». 'Compute fix, 0), fix, l.t,... until y is found such that 
f[ x ^ y\ = 0'. This procedure may not terminate iff is not total, even if such 
a y exists; for instance, if fix, 0) is undefined but /tar, I J = 0, 

Thus we arc led to the followinc definition of the mimmchsanon 
operator *t, which yields computable functions from computable 
functions. 



5.1. Definition 

For any function fix, > 1 

I the least y such that 

<ii fix, z ) is defined, allz ^ y. and 
(ii) f(x, y ) - 0, if such a y exists, 
undefined, if there is no such y. 

fty\ ... i is read "the least y such that . . .'. This operator is sometimes 
called simply the ^.-operator. 



M.yl/(*.y)=0}= 



The nc.xl theorem shows that <€ is closed under minimalisation. 



5.2. Theorem 

Suppose that fix, y) is computable; then so it the function jr(x) = 

Proof, Suppose that x = yx u ..,*„> and that F is a program in stan- 
dard form that computes the function fix, y '. Let m = maxin + I, p(F)). 
We write a program G that embodies the natural algorithm for g: for 
ft =0, 1,2 ... . compute fix, k) until a value of ft is found such that 
fix, ft) = 0; this value of ft is the required output. 

The value of x and the current value of ft will be stored in registers 
R„ | R„.„_i before computing /U, ft>: thus the typical configura- 
tion will be 

Storage registers 



Rl . .« R„- R m -I . • , R,t,-t»iR*T <*!•! Rm-n-2 



ft 



i; 



with ft =0 initially. Note that r in ., : . 2 is always 0. 



A Row diagram Ihat carries out the above procedure for g is given in fig. 
2d. This translates easily into the following program C (or g: 
Tvl.m + 1) 

Tin, m+n] 

J P F[m + I, nt -2 m+n + 1-* I] 

S{l.m + n+2,q) 
Sim + n+l) 

/, Tfm+n + 1.1) 
i_I f is the first instruction of the subroutine / r fmTl,m + 2. . ..-*■!].) □ 



Fig. 2»7. Minimalisation '.theorem 5.2). 
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5.3. Corollary- 
Suppose that Rix, y\ is a decidabie predicate: then the function 

glx) = v,yR{x.y) 

' the teas: v such that Rix, y) holds, if there is such a >\ 






[ undefined 
is computable 

Proof. g(x) = ^y(sgic R i>,y)) = 0). ZJ 



otherwise. 



In view of this corollary, the ^-operator is often called a search 
operator. Given a decidabie predicate Rix, y) the function eix) searches 
for a y such that Rix, y) holds, and moreover, finds the least such > if 
there is one. 

The ^-operator may generate a non -total computable function from a 
total computable function; for instance, putting fix,y) = \x — y~\, and 
gix)-'vy(f{x, y] = 0), we have that g is the non-total function 

I Vx if x is a perfect square, 

I undefined otherwise. 
Thus, in a trivial sense, using the ^-operator together with substitution 
and recursion, we can generate from the basic functions more functions 
than can be obtained using only substitution and recursion (since these 
operations always yield total functions from total functions). There are 
also, however, tola! functions for which the use of the ^-operator is 
essential. Example 5.5 below gives one such function ; we present another 
example in chapter 5. Thus we see that, in a strong sense, minimalisation. 
unlike bounded minimalisation, cannot be defined in terms of substitu- 
tion and recursion. It turns out, nevertheless, that most commonly 
occurring computable total functions can be built up from the basic 
functions using substitution and recursion only: such functions are called 
primitive recursive, and are discussed further in chapter 3 § 3. In practice, 
of course, we might establish the computability of these functions by what 
amounts to a non-essential use of minimalisation, if this makes the task 
easier. 



5 .4. Exercises 

1. Suppose that fix) is a total injective computable function: prove 
that f is computable. 

2. Suppose that pix) is a polynomial with integer coefficients: show 
that the function 
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/(a ) = least non-negative integral root of p{x)~a{a€ 
is computable (/{fl) is undefined if there is no such root). 
3. Show that the function 



•h 



if y * and y i x. 



I*' 

t undefined otherwise. 
is computable. 



We conclude this chapter with an example of a function that makes 
essential use of the ^-operator; it also shows how this operator can he 
used not only to search for a single number possessing a given property, 
but to search for finite sequences or sets of numbers, or other objects 
coded by a single number. The function is a modification by Peter of an 
example due to Ackermann, after whom it is named. It is rather more 
complicated than any function we have considered so far. 



5.5. Example (The Ackermann function) 

The function ti/lx, y) given by the following equations is 
computable: 

tf(O t y) = > + l, 

tf[jc + 1.0)-ifr[x, 1), 

iMx - 1, y + I ) - (jmx, ifrU - 1 . y .t). 

This definition involves a kind of double recursion that is stronger than 
the primitive recursion discussed in § 3. To see, nevertheless, that these 
equations do unambiguously define a function, notice that any value 
ifrU, y) (x>0) is defined in terms of earlier' values &(x u y s ) with Xt<x 
or xi = x and yi < y. In fact, Mx, y) can be obtained by using only a finite 
number of such earlier values: this is easily. established by induction on x 
and y. Hence ^ is computable in the informal sense. For instance, it is easy 
to calculate that Ml, l) = 3 and i£l2, 1) = 5. 

To show rigorously that ev is computable is quite difficult. We sketch a 
proof using the idea of a suitable set of triples 5". The essential property of 
a suitable set S (defined below t is that if (x, y,z)e S, then 

(5.6) (i) z = ^x,y), 

(ii) S contains all the earlier triples 

Ui, yi, ifrixi, y-Sf that are needed to calculate cWx, y). 
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Definition 

A finite set of triples S is said to be suitable if the following 
conditions are satisfied: 

(a) if (O.y.zieSthen ; = > + l, 

(ft) if (x*l, 0,2)5 S then <x, 1, z)€S, 

(c) if (x + 1, y + 1, z )e S then there is u such that (x + 1, y, if)cS 

and <x, «. z)eS. 
These three conditions correspond to the three clauses in the definition of 
ib: for instance, (a) corresponds to the statement: if r = tH0,y», then 
jay+1; (c) corresponds to the statement: if z = (frfx 4 -l, y — 1), then 
there is u such that u = \b{x- l.yi and z = i!f{x, m). 

The defimtion of a suitable set S ensures that (5.6) is satisfied. 
Moreover, for any particular pair of numbers lm, n) there is a suitable set 
S such that (m,n,if/(m, n))$S', for example, let 5 be the set of triples 
(x.y, *!>yx, y)) that are used in the calculation of ii/{m, n). 

Now a triple U,.y, z) can be coded by the single positive number 
u = 2*3 y 5" ; a finite set of positive numbers {m-., .... u k ) can be coded by 
the single number ^..p*. . . . p Uv Hence a finite set of triples can be coded 
by a single number v say. Let S,. denote the set of triples aided by the 
number v. Then we have 

(x, y, z)€ 5, « p2'3*> ! divides v, 

so'U, y, z)eSo is a decidable predicate of x.y. z, t>; and if it holds, then x. 
y, z < o. Hence, using the techniques and functions of earlier sections we 
can show that the following predicate is deeidahle: 

Rlx, y, y| = 'i> is the code number of a suitable set 
of triples and 3 z < v ({x, y, z) e $„).' 

Thus the function 

fix, y) = iivR{x, y, v) 
is a computable function that searches for the code of a suitable set 
containing (x, y, z) for some z. Hence 

which shows that # is computable. 



A more sophisticated proof that </* is computable will be given in 
chapter 10 as an application of more advanced theoretical results. 

We do not prove here that ib cannot be shown to be computable using 
substitution and recursion alone. This matter is further discussed in $ 3 of 
the next chapter. 



Other approaches to 
computability: Church's thesis 



Over the past fifty years there have been many proposals for a precise 
mathematical characterisation of the intuitive idea of effective compu- 
tability. The URM approach is one of the more recent oF these. In this 
chapter we pause m our investigation of URM -computability itself to 
consider two related questions. 

1. How do the many different approaches to the characterisation of 
computability compare with each other, and in particular with 
URM-compu lability? 

2. How well do these approaches (particularly the URM approach) 
characterise the informal idea of effective computability? 

The first question will be discussed in §§ 1-6; the second will be taken 
up in § 7. The reader interested only in the technical development of the 
theory in this book may omit §§ 3-6; none of the development in later 
chapters depends on these sections. 



1. Other approaches to computability 

The following are some of the alternative characterisations that 
have been proposed: 

\a) Codel-Herbrand-Kieene (1936). General recursive 
functions defined by means of an equation calculus. (Kleene 
11952]. Mendelson [1964].) 

Kb) Church (1936). A-definable functions. (Church [1936] or 

[1941].) 

tfi) Gbdel-Kieenc (1936). ^-recursive functions and partial 

recursive functions (§ 2 of this chapter.). 

id) Turing (1936}. Functions computable by finite machines 

known as Turing machines. (Turing [ 1 936]; § 4 of this chapter.) 

{el Post (1943). Functions defined from canonical deduction 

systems. (Post [1943], Minsk* [1967]; S5 of this chapter.) 
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(ft Markov ( 1 951 ). Functions given by certain algorithms over a 

finite alphabet. (Markov [19541, Mendelson [1964]; §5 of this 

chapter.) 

Kg) Shepherdson-Sturgis (1963). URM-computable functions. 

(Shepherdson & Sturgis[l963].l 
There is great diversity among these various approaches: each has its 
own rationale for being considered a plausible characterisation of 
computability. The remarkable result of investigation by many resear- 
chers is the following: 

1.1. The Fundamental result 

Each of the above proposals for a characterisation of the notion of 
effective computability gives rise to the same class of functions, the class thai 
we have denoted <€. 

Thus we have the simplest possible answer to the first question posed 
above. Before discussing the second question, we shall examine briefly 
the approaches of Godel-Kleene, Turing. Post and Markov, mentioned 
above, and we will sketch some of the proofs of the equivalence of these 
with the URM approach. The reader interested to discover full details of 
these and other approaches, and proofs of all the equivalences in the 
Fundamental result, may consult the references indicated. 



2. 



Partial recursive functions (Godel-Kleene) 



2.1. Definition 

The class '31 of partial recursive functions isilwsTnallest c |ass of 
partial functions that contains the basic functions 0, x + 1, Ui" (lemma 
2-1.1) and is closed under the operations of substitution, recursion and 
minimalisation. (Equivalent!)'. i# is the class of partial functions that can 
be built up from the basic functions by a finite number of operations of 
substitution, recursion or minimalisation.) 

Note that in the definition of the class 31, no restriction is placed on the 
use of the p. -operator, so that $ contains non-total functions. Godel and 
Kleene originally confined their attention to total functions; the class of 
functions first considered was the class .^o of n-recursive functions, 
defined like 3r above, except that applications of the ^-operator are 
allowed only if a total function results. Thus $c is a class of total 
functions, and clearly #<.£<#. In fact, 0t o contains all of the total 



i«# < VXIft 
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(unctions that arc in i%, although this is not immediately obvious; see 
corollary 2.3 below for a proof. Hence & is a natural extension of J# to a 
class of partial functions. 

The term recursive function is used nowadays to describe /^-recursive 
functions: so a recursive function is always total -it is a totallv defined 
partial recursive function. The term genera! recursive function is some- 
times used to describe fi-recursive functions, although historically, this 
was the name Kleenc gave to Ihc total functions given by his equation 
calculus approach i(a) in § 1>. It was Kleenc who proved the equivalence 
of general recursive functions (given by the equation calculus) and 
^-recursive functions. 



We now outline a proof of 

2-2. Theorem 

Proof. From the main results of chapter 2 (lemma 1.1. theorems 3.1, 

4.4, 5.2) it follows that & c «. 

For the converse, suppose that fix) is a URM-computable function, 
computed by a program P = /„...,/„ By a step in acomputation Pi x > we 
mean the implementation of one instruction. Consider the following 
functions connected with computations under P. 

contents of R t after r steps in the computation 
Pix), if Pyx) has not already stopped: 



c<x,t) = 



f>X,t> = 



the final contents of R : if Pix) has stopped 
• after fewer than / steps. 

number of the next instruction, when / steps of 
the computation P(x ) have been performed, 
if P{x) has not stopped after l steps or fewer; 



if P[x) has stopped after ; steps or fewer. 
Clearly c and j are total functions. 
If fix) is defined, then Plxt converges after exactly t steps, where 
fo = fit(i(x, t) - ()), 
and then 

flx) = c(x,t ). 

If. on the cither hand,/(x) is not defined, then P(x) diverges, and so/{x, t) 
is never zero. Thus m'O'U. t) = 0) is undefined. Hence, in either case, we 



have 

f{x) ^eix,nt{j(x,t) = (*))■ 
So, to show that /is partial recursive, it insufficient to show that c and/ 
are recursive functions. It is clear that these functions arc computable in 
the informal sense - we can simply simulate the computation P(x) for up 
to r steps. By a detailed analysis of computations Pix) and utilising many 
of the functions obtained in chapter 2, it is not difficult, though rather 
tedious, to show that c and / are recursive; in fact, they can be obtained 
from the basic functions without the use of minimalisaiion (so they are 
primitive recursive — see § 3 of this chapter). (A detailed proof of rather 
more than this will be given in chapter 5 -theorem 1.2 and Appendix). 
Hence / is partial recursive. "3 

2.3. Corollary 

Every total function in '3t belongs to .#■». 
Proof. Suppose that fix) is a total function in 'Jt\ then f is URM- 
compuiablc by a program P. Let c and / be the functions defined in the 
proof of theorem 2.2; as noted there, these can be obtained without any 
use of minimalisaiion, so in particular they are in #.>. Further, since f is 
total, P{x) converges for every x, so the function nil i (x, t) = 0) is total and 
belongs to $o- Now 

fix)~c(x,ntij{x.rt = Q)), 
so f also is in i# . D 

A predicate Mix ) whose characteristic function Cm is recursive is called 
a recursive predicate. In view of theorem 2.2, a recursive predicate is the 
same as a decidable predicate. 

3. A digression: the primitive recursive functions 

This is a natural point to mention an important subclass of j?, the 
class of primitive recursive functions, although they do not form part of the 
main line of thought in this chapter. These functions were referred to in 

chapter 2 §5. 



3.1. Definition 

{a) The class 3"3t of primitive recursive functions is the smallest 
class of functions that contains the basic functions 0. x + 1, U?, 
and is closed under the operations of substitution and recursion. 
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{£) A primitive recursive predicate is one whose characteristic 
function is primitive recursive. 

All of the particular computable functions obtained in §§ 1. 3, 4 of 
chapter 2 are primitive recursive, since miniraalisation was not used 
there. We have already noted that the functions c and /' used in the proof 
of theorem 2.2 are primitive recursive. Further, from theorems 2-4.10 
and 2-4.12 we see that 9>di is closed under bounded sums and products, 
and under bounded minimalisation. Thus the class of primitive recursive 
functions is quite extensive. 

There are nevertheless recursive functions (or, equivalently. total 
computable functions) that are not primitive recursive. Indeed, the 
Ackermann function <>) of example 2-5.5 was given as an instance of such 
a function. A detailed proof that the Ackermann function is not primitive 
recursive is rather lengthy, and we refer the reader to Peter [1967, 
chapter 9J or Mendelson f 1 964, p. 250, exercise 1 1], Essentially one 
shows that tit grows faster than any given primitive recursive function. (To 
see how fast ^ grows try to calculate a few simple values.) 

In chapter 5 wc will be able to give an example of a total computable 
(i.e. recursive) function that we shall prove is not primitive recursive. 

Our conclusion is that although the primitive recursive functions form a 
natural and very extensive class, they do not include all computable 
functions and thus fall short as a possible characterisation of the informal 
notion of computability. 



4. Turing- com potability 

The definition of computability proposed by A. M. Turing [1936] 
is based on an analysis of a human agent's implementation of an 
algorithm, using pen and paper. Turing viewed this as a succession of very 
simple acts of the following kinds 

{a) writing or erasing a single symbol. 

(b) transferring attention from one part of the paper to another. 
At each stage the algorithm specifies the action to be performed next. 
This depends only on Q) the symbol on the part of the paper currently 
being scrutinised by the agent, and fii> the current state (of mind) of the 
agent. For the purposes of implementing the algorithm this is assumed to 
be determined entirely by the algorithm and the history of the operation 
so far. It may incorporate a partial record of what has happened to date, 
but it will not reflect the mood or intelligence of the agent, or the state of 
his indigestion. Moreover, there are only finitely many distinguishable 
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states in which the agent can be. because he is finite. The state of the agent 
may, of course, change as a result of the action taken at this stage. 

Turing devised finite machines that carry out algorithms conceived in 
this way. There is a different machine tor each algorithm. We shall briefly 
describe these machines, which have become known as Turing machines. 



4.1 . Turing machines. 

A Turing machine M is a finite device, which performs opera- 
tions on a paper tape. This tape is infinite in both directions, and is divided 
into single squares along its length. (The tape represents the paper used 
by a human agent implementing an algorithm; each square represents a 
portion of the paper capable of being viewed in a given instant. In any 
particular terminating computation under ki only a finite part of the tape 
will be used, although we may not know in advance how much will he 
needed. The tape is nevertheless infinite, corresponding to the human 
situation where we envisage an unlimited supply of clean paper. > 

At any given time each square of the tape is either blank or contains a 
single symbol from a fixed finite list of symbols s,,J2, . . . ,s,,Ahc alphabet 
of M. We will let B denote a blank, and count it as the symbol Sj belonging 
to Af \ alphabet. 

A-/ has a reading head which at any given time scans or reads a single 
square of the tape. We can visualise this as shown in fig. 3a. 

M is capable of three kinds of simple operation on the tape, namely: 



Fig. 3«. A Turing machine. 
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la ) erase ihe symbol in ihc square being scanned and replace il 
by another symbol from the alphabet of M\ 

(b) move the reading head one square to Ihe right of that being 
scanned (or, equivalently, move the tape one square to the left), 

(c) move the reading head one square to the left of rhat being 
scanned (or, equivalently, move the tape one square to ihc right). 

At any given time M is in one of a fixed finite number of states, 

represented by symbols q u q„. During operation the state of M can 

change. We may envisage the symbol for the current state as being 
displayed in a window on the exterior of M (as in fig. 3d ), and think of this 
as a partial guide to what has happened to date and what will happen in 
the future. 

The action that M takes at any instant depends on the current state of 
M and on the symbol currently being scanned. This dependence is 
described in M 's specification which consists of a finite set Q of quadru- 
ples, each of which takes one of the following forms 



WW* 

qtStRq, 
WjLq, 



UU 



Os/.fcsJ 



A quadruple qts / aq l in Q specifies the action to be taken by M when it 
is in the state q, and scanning the symbol s ; , as follows: 
I. Operate on the tape thus: 
{a » if a = s k , erase s, and write s k in the square being scanned; 

(b) if a = K, move the reading head one square to the right; 

(c) if a =L, move the reading head one square to the left; 
2. Change into state q t . 

The specification Q is such that for every pair qft there is at most one 
quadruple of the form q lSi u0 ; otherwise there could be ambiguity about 
what M does next. 

To begin a computation. M must be provided with a tape and posi- 
tioned so that a specified square is being scanned; further, M must be set 
in some prescribed initial state. Then, if M is in the state q, and scans the 
symbol s h it acts as described above provided that there is a quadruple of 
the form q i s fi Lq i in Q. This kind of action is then repeated for the new state 
and symbol scanned, and so on. M continues in this way for as long as 
possible. The operation of M terminates only when it is in a state q ; 
scanning a symbol s, such that there is no quadruple of the form q,s<a$ in 



O. i.e. there is no quadruple in Q that specifies what to do next. (Il is 
possible that this never happens.) 

4.2. Example 

Let M be a Turing machine whose alphabet consists of the 
symbols 0, 1 ■ (and a blank of course) and whose possible states are q t and 
qi. The specification of M is 

qxORq, 

qil0q 2 

q 2 lRq: 
Suppose that M is provided with the tape 

1 



1 1 111 1 I 1 1 1 1 



scanning Ihe square marked J. and initially in slate q x . It is easy io see that 
M 's action is to work from left to right along the tape, replacing alternate 
Is by ihe symbol 0; M stops when it scans the first blank square since 
there is no quadruple thai specifies what it should do. The resulting tape 

i 







1,0 1 
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with the square marked i being scanned, and M is in stale q\. 

On ihe other hand, if M is provided with a lape such that every square 
contains the symbol or 1 , then the operation of ,Vf never stops. 



It is clear from Ihis example thai a Turing machine M is a device for 
effecting an algorithm lhat operates on tapes. Complete details of the 
algorithm are contained in the specification Q of A/. Thus, for the 
mathematician, a Turing machine is defined to be the set of quadruples 
that specify it. It is not usual to build physical Turing machines, except for 
illustrative purposes. 

4.3, Turing-computable functions 

In order to regard a Turing machine M as computing a numerical 
function, we must use some convention for representing numbers on a 
tape. One way is as follows: suppose, for convenience of exposition, lhat 
the symbol $i of M 's alphabet is I . We use 1 as a 'tally symbol', and then 



represent a number x on (he tape as follows (ignore the marker 4 for the 
moment): 



I 1 



< x + 1 squares » 

We use x + 1 tally*, to represent x, so as to distinguish from a blank tape. 
The partial function fix > computed by M is defined as follows. Consider 
the computation by M on the above tape, starting in state q ( , and initially 
scanning the square marked i. Then 

'the total number of occurrences of the symbol 1 
f(x)= ■■' on [ he final tape, if this computation eventually stops; 

■ undefined otherwise. 

Similarly, the n-ary partial function f{x\, ...,x n ) computed by ,Vf is 
defined by counting the number of 1 s on the final tape when M is started 
in state q \ and scanning the square marked _ on the following tape: 

1 



: l 
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squares 



-X 2 -\- 

squares 



squares 



4.4. Definition 

A partial function is Turing-computable if there is a Turing 
machine that computes il. The class of all Turing-computable functions is 
denoted 3~€. 



4.5. Example 

The function x + y is Tunng-computable; the Turing machine 
given by the following specification Turing-computes this function. 

felBft 

qiBRqi 

qzlBq, 

q 2 BRq 2 



The tape representation of ■>, y) contains x + y-t-2 occurrence*, of the 
symbol 1, so the machine M is designed to erase the first two of these 
occurrences starting from the left. The details are easy to check by trying a 
few particular values for x, y. 

4.6. Exercises 

1. What unary function is Turing-computed by the machine in 

example 4.2? 

2. Devise Turing machines that will Turing-compute the functions 
(tr)*-1 ib) lx. 

It is not our purpose here to develop the theory of Turing machines and 
Turing-computable functions; the interested reader should consult the 
books by Davis [1958] or Minsky [1967] listed in the bibliography. 

The fundamental result linking Turing-computabilily with partial 
recursive functions and URM -com pu lability is the following. 

4.7. Theorem 

& = #% = ¥. 

Proof. There are various ways of establishing this result, which we 
indicate in barest outline. 

A direct proof that 9% Q .# is somewhat similar lo the proof that tf c 31 
(theorem 2.2). The tape configurations and states of a Turing machine 
during a computation can be coded by natural numbers, and the opera- 
tion of the machine is then represented by recursive functions of these 
numbers. 

For the converse inclusion, 9t £ &*$, one can show directly that £T¥ 
contains the basic functions and is closed under substitution, recursion, 
and minimalisation. This is done in detail in Davis [1958'. Alternatively, 
one can show that '4 £ 3*g by showing that URMs are equivalent in 
power to a succession of simpler machines, ending with Turing machines. 
This is the proof given in their original paper by Shepherdson & Sturgis 
[1963], D 



5. Symbol manipulation systems of Post and Markov 

E. L. Post and A. A. Markov formulated their ideas of 
effectiveness in terms of strings of symbols. They recognised that objects 
(including numbers) to which effective processes apply can always be 
represented as strings of symbols; in fact, in contexts such as symbolic 
logic, abstract algebra and the analysis of languages the objects actually 



arc strings of symbols. Both Post and Markov, from different points of 
view, considered that effective operations on strings of symbols are those 
that arc built up from very simple manipulations of the strings them- 
selves. 

Post's central idea was that of a canonical system, which we describe 
below. Such systems do not compute functions; they generate sets of 
strings. This is because Post aimed to characterise format logical systems ; 
i.e. systems that generate theorems from axioms by the mechanical 
application of rules of logic. Thus a notion of effectiveness emerges from 
Post's work, initially in the guise of effectively (or mechanically) generated 
sets. We shall see how a notion of a Post-computable function can be 
derived from this. 

In paragraph 5.17 below we explain the way in which Markovs 
approach is related to that of Post. 

We must now define some notation to aid our discussion. Let 1 = 
{a,, . . . , a k ) be a finite set of symbols, called an alphabet. A string from X 
is any sequence a, t . . . a^ of symbols from X Strings are sometimes 
called words, by analogy with ordinary language. For any alphabet X we 
write I* to denote the set of all strings from X Included in X* is the empty 
siring, denoted A, that has no symbols. If a- = b x b 2 . . . b m and t = c, . . . c \ 
are strings then itt denotes the string bt-.. 6«d ...•«* The empty string 
A has the property that for any string o*, tr.l = cr = Act. 



5.1. Post-systems 

In elementary algebra a common operation is to replace the 
string (x -y)(x + >•) whenever it occurs by the string fx'-y 2 ). This string 
manipulation ma> be denoted by writing 

St(x-y)ix+y)$ 2 -* S^-y^St 

where S t and $ 2 are arbitrary strings. 

A more general manipulation of a siring, yet still regarded by Post as 
elementary, takes the form 



(5-2) goSigtS* . . . g„ iS mgm - hoSt.MS.M . . . Si n h„ 

where 

(0 gu. • • - . g««, hy, .... h„ are fixed strings (and may be null), 

(ii) the subscripts /, i n are all from 1,2 m, and need 

not be distinct. 



.? systems or rosi ana mar/cov 
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Post called an operation of the form {5.2) a production, it may be 
applied to any string tr thai can be analysed as 

v= gnwigio-2 ■ • • <r m g m i>i, . . . , <r n are strings), 

to produce the siring kf/r^hitr^ . . . a tr h n . 

5.3. Example 

Let X = {a, b\: consider the production 

(*•) aSibS 2 •* S 2 a$ 2 a. 
Then the effect of [it I on some strings is given in the table 

a Strings produced by iff) 



aba -tasti 

abba aaaa and baabaa 

ba (rr) does not apply. 



(The entries in the second line correspond to the two possible analyses of 

abba a A bba 
aoba : as "r* T and « ^ •) 

5.4. Exercise 

Examine the ways in which the production 

S x bS 2 aaSr.b -* S 3 abS t 
applies to the string babaabbaab. 

Productions form the main ingredient of Post's canonical systems: 



5.5. Definition 

A Post- {canonical) system "€ consists of 

(a) a finite alphabet X. 

(b) a finite subset A of X*. the axioms of ft, 

(c) a finite set Q of productions of the form 15.2), whose fixed 
strings are in X*. 

We say that •# is a Post-system over X 

We write a- => r if the string t can be obtained from the string v by a 
finite succession of applications of productions in Q; then we write 15 7 if 

there is an axiom csA such that a ^t. In this case we say that t is 
generated by the Post-system ; the set of all strings in X* generated by tf is 
denoted 7» i.e. 



The set 7" rf is also called Ihc set of theorems of & reflecting the original 
motivation of Post. 



5.6. Example 

Let 3? be the Post-system with alphabet I = \a, b), axioms A, a, b 
and productions S -*■ aSa and S -» bSb. Then 7\, is the set at palindromes - 
the strings reading the same in either direction, such as aba, bbabb, abba. 

Sometimes, in order to generate a particular set of strings in X* it is 
necessary to use auxiliary symbols in the generation process. This leads to 
the following definition 



5.7. Definition 

Let I he an alphabet and let X <^I". Then X is Post-generabie if 
there is an alphabet 1 x bS and a Post-system ^ over i ; such that X is the 
set of strings in I* that are generated by % i.e. X = T v r\S*. 

Post proved a remarkable theorem showing that really only very simple 
productions are needed to generate Post-generable sets. A set of produc- 
tions Q land any system in which they occur) is said to be norma! if all the 
productions have the form gS ■* Sh. 

Post proved 



5.8. Theorem {Post's normal form theorem) 

Any Post-generabie set car, be generated by a norma! system. 
For an excellent proof consult Minsky [^1967]. 



Post-systems having only productions of the kind 

give models of grammars and languages. They reflect the way in which 
complex sentences of a language are built up from certain basic units 
according to the rules of grammar. Restrictions on the nature of % and h 
provide the context-sensitive and context-free languages of Chomsky, 
which provide useful models of languages used in computer program- 
ming. We cannot pursue this interesting topic here: the reader may 
consult the books of Arbib [1969] and Manna fl9741 Tor further 
information. 



*r ^v»ie«« •« 



trill ,*1*('.\*'L 



5.9 Post-systems and other approaches to comvutairility 

As we have seen. Post-systems give a characterisation of the 
notion of an effectively generated set. We may compare this with the 
corresponding notion that emerges from the other approaches to compu- 
tability. For URM-computability (or Turing-computability, etc.) 
effectively generated sets of numbers are called recursively enumerable 
i.r.e.l; these are the sets that are the range of some URM-compu table 
function. (We shall study r.e. sets in chapter 7.) 

To compare sets of strings with sets of numbers, we choose an (intui- 
tively) effective coding function ": i" -» fy under which the string tr el* is 
coded by the number a. A convenient method for an alphabet £ = 
{ai,-..,flft) is by the k-adic coding where ': i**-»\ is defined by A -0; 
u^777aZ;-rn + rik + .. .+r m k m . It is easily seen that ' is actually a 
bijection, so if the inverse of is denoted by : ftl-»£* we also have a 
representation of each number n by a string n. 

Suppose now that X is a set of strings: let X = {t? : <* € X } T the set of 
numbers coding X. We have the equivalence result: 



5.10. Theorem 

X is Post-generabie iff X is r.e. 
Proof. We sketch one proof of this result. Let X ^ 2" and suppose first 
that X is r.e. Let X = Ran( /"!, where /' is U RM -computable . Using earlier 
equivalences we can design a Turing machine M whose symbols include 
the alphabet 2, so that when in state q, and given initial tape 



. 



(*) 



rtj + l 



M halts if and only if m € Domi./'i, and does so in the following configura- 
tion 



T 



t 



)(»» 



i.e. the symbols on the non-blank part of the tape indicated constitute the 
string fim) from X, and M is in a special halting state q M scanning the 
square marked J. Now devise a Post-system c $ to simulate the behaviour 
of M on its tape; the alphabet of $ will include 2' and the symbols and 



slates of M; ^ will generate strings of ihc form 

5, ,5. ; . . . q k s, t . . . y,, 
to represent anv situation 

? 



•fi, 



*i\ 



>. 



"■» 



that occurs during the computation by M from an initial tape of the form 
(*>. To gel things going, ''$ will generate all strings of the form 

<j, 111 ... 11, which represent such initial tapes. If we include in ^ the 
production q H S ■* S, then the strings from I* generated by ^ will be the 
set 

{fUn): m e Dom(/j} = {n:nc Ran(/)) = {h : n c *} = X. 

Thus X = T rf « v*, so AT is Post generable. 

Conversely, if X is Post-gencrable by a Post-system '&, show that the 
relation 

'n is generated by t$ using at most m productions' 

is decidable; from the theory of r.e. sets (chapter 7 ) it follows easily that X 
isr.e. D 

5.11. Post-computabtlity 

We now explain two ways to derive a concept of computable 

function from Post-systems.In both cases the concept is defined first for 

functions on I*, and then extended to N by coding or representation. 

Suppose that/: 2* -> 1* is a partial function. Select a symbol ■ not in I 

and consider the set of strings 

G(J) = \<r - f(tr): a s Dom(/)} 

from the alphabet £«-*{•}. The set Gift contains all information about/, 
and we define: 

5.12. Definition 

/: !*-*•!* is Post-computable if G{f) is Post-gen era hie. • 

5.13. Example 

Let I = { 1} and consider the function /: I* -* X* given by 

/(n...ii)=nii...iiii. 



* n 



3 yystems of rose ana warxov »-* 

The set G(f) is generated by the following Post-system: 

Alphabet {U -) 
Axiom -( = A ■ fiA)) 
Production Si* St -* S ( l • S 2 S : S,1. 
The single production of this system applies to a string of the form 
11... 11 -111. ..11] 

to produce the string 

ii ...ni-iii.. .inn. ..mi. ..in. 

Hence f is Post-computable. 

Suppose that Gif) is generated by a Post-system '•&. To see thai/ is 
computable in the informal sense, consider the following algorithm for 
finding /(tr) (where tr£i*). 

'Generate the strings 7% in some systematic fashion ; examine these as 
they appear, looking for a string of the form it ■ r with rel*. Such a 
string will eventually be produced if, and only if, a-eDom(A and then 
T=f[<r): 

The definition (5.1 21 extends in an obvious way to partial functions 
\X"V -*!'. Post -computabi lily on N is then defined using any effective 
representation ~: ^l-*.!* in the natural way: 



5.14. Definition 

Let g: ¥* -* 



i be a partial function, and let 



m-€ 



§ : {£*)" -* I* be the function defined by 
gim-.mi, . .-,mj = gvm : ,. . . ,m«> (mi. 
Then g is Post-computable if g is Post-computable. 

Ii we let 'J*£ denote the class of Post- computable functions of natural 
numbers, we have the equivalence: 



5.15. Theorem 

§>% = % = g~^ = &. (We omit a proof. When the reader has 

studied chapters 6 and 7 he should be able to sec that this follows from 

theorem 5.10 and the results of chapters 6 and 7 linking r.e. sets with 

URM-computable functions.) 



•ft" 1 
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6.2. Example 

D=l*. where I = [a*b\. The class 'M" of pama/ recursive 
functions on X" is !hc smallest class of partial functions such thai 
(a) the basic functions 

(i)/(<7) = .1 

(ii) f(*r) = tra 

(hi) f(tx) = trb 

{iv> the projection functions Uffci, • ■ • . <^i) = o* 
are in »*\ 
(t») 9? ! ' is closed under substitution. 



(c) <T 
form; 



is closed under primitive recursive definitions of the following 



hi<r,A)-f{tr) 

h (tr, ra) = gi(<r. r, h{<r, r)) 

h [tr, rb ) » g 2 (<r, r, fc(o\ r)J 

where A gi, gte&°, 

{d) $ is closed under minimaiisation if /(<7, 7) is in iS? , so is the 

function h given by 

h(<r)~u,7(f(<r,T) = A) 

where n~ means the first 7 in the natural ordering .1, a, b, aa, ah, ha, bb. 
uaa, aab, aba, .... 

For each of these, and other approaches to computability on a domain 
D that utilise the intrinsic structure of D, we find as expected that they are 
equivalent to the approach that transfers the notion of computability 
from N by using coding. And, vice versa, any natural notion of compu- 
tability on a domain D induces an alternative (but equivalent) notion of 
computability on P^ via coding, as with Post-corn putability in S 5. 



6.3. Exercises 

1 . Prove that URM-coniputability on £ as outlined in example 6. 1 
is equivalent to URM-compuiability via coding (example 1 -5. 1 1. 

2. Prove that the class M " of partial recursive functions on 1*, as 
defined in example 6.2, is identical to the Pom -computable 
functions on X*. 

3. Suggest natural definitions of computability on the domains (a) 
3x3 matrices, Kb) Q (rational numbers). 

4. Give a natural definition of Turing-computability on 2", where 
1 is any finite alphabet. 



7. Church's thesis 

We now turn our attention to the second question of the intro- 
duction to this chapter: how well is the informal and intuitive idea of 
effectively computable function captured by the various formal charac- 
terisations? 

In the light of their investigations. Church, Turing and Markov each 
put forward the claim that the class of functions he had defined coincides 
with the informally defined class of effectively computable functions. In 
view of the Fundamental result (1.1), these claims are all mathematically 
equivalent. The name Church's thesis (sometimes the Church-Turing 
thesis) is now used to describe any of these other claims. Thus, in terms of 
the URM approach, we can state: 



Church's thesis 

The intuitively and informally defined class of effectively 
computable partial functions coincides exactly with the class '€ of URM- 
computable functions. 

Note immediately that this thesis is not a theorem which is susceptible 
to mathematical proof: it has the status of a claim or belief which must be 
substantiated by evidence. The evidence for Church's thesis, which we 
summarise below, is impressive. 

1. The Fundamental result: many independent proposals for a 
precise formulation of the intuitive idea have led to the same 
class of functions, which we have called %. 

2. A vast collection of effectively computable functions has been 
shown explicitly to belong to '■€: the particular functions of 
chapter 2 constitute the beginning of such a collection, which can 
be enlarged ad infinitum by the techniques of that chapter, and 
other more sophisticated methods. 

3. The implementation of a program P on the URM to compute a 
function is clearly an example of an algorithm ; thus, directly from 
the definition of the class % we see that all functions in ^ are 
computable in the informal sense. Similarly with all the other 
equivalent classes, the very definitions are such as to demon- 
strate that the functions involved are effectively computable. 

4. No one has ever found a function that would be accepted as 
computable in the informal sense, that does not belong to *. 

On the basis of this evidence, and that of their own experience, most 
mathematicians are led to accept Church's thesis. For our part, we 
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propose to accept and use Church's thesis throughout the rest of this 
book, in a way that we now explain. 

Suppose that we have an informally described algorithm for computing 
the values of a function /. Such an algorithm may be described in English, 
or by means of diagrams, or in semi-formal mathematical terms, or by any 
other means that communicate unambiguously how to effectively cal- 
culate the values of f, where defined, in a finite amount of time. In such a 
situation we may wish to prove thai / is URM-computable. There are, 
broadly, two methods open to us. 

Method 7. Write a program that L"RM-computes / {and prove that it 
does sot, or prove by indirect means that such a program exists. This could 
be done, for instance, by the methods of chapter 2, or by showing that / 
belongs to one of the many classes shown by the Fundamental result to be 
equivalent to '4. 

Such a full and formal proof that / is URM-computablc may be a long 
and rather technical process. Essentially it would involve translation of 
the informally described algorithm into a program or into the language of 
one of the other formal characterisations. Probably there would be 
various flow diagrams as intermediate translations. 

Method 2. Give an informal (though rigorous) proof that the given 
informal algorithm is indeed an algorithm that serves to compute/. Then 
appeal to Church's thesis and conclude immediately that / is URM- 
computablc. 

We propose to accept method 2 as a valid method of proof, which we 
call proof by Church's thesis. 



7.1. Example* 

1 . Let P be a URM program; define a function f by 

[1 if P{x'>ly after r or fewer steps 
fix, y, t) = < of the computation P[x), 
[0 otherwise. 

An informal algorithm for computing / is as follows. 

'Given {x, y, rt, simulate the computation Pi>) (on a piece of 
paper, for example, as in example 1-2.1!, earning out .• steps of 
PUI unless this compulation stops after fewer than i steps. If 
P(x) stops after t or fewer steps, with y finally in Ri, then 
f(x, y, t) - 1. Otherwise ti-e. if P{x) stops in r or fewer steps with 



some number other than y in Ri, or if P{x 1 has not stopped after t 
steps) we have fix, y, t) m 0." 

Simulation of P{x) for at most f steps is clearly a mechanical 

procedure, which can be completed in a finite amount of time. 

Thus, fis effectively computable. Hence, by Church's thesis, / is 

URM-computable. 

2. Suppose that / and g are unary effectively computable functions. 



Define a function h by 



Mx) = 



if x € Dom( f} or x e Dom(g), 



undefined otherwise. 
An algorithm for h can be described in terms of given algorithms 
for the effectively computable functions / and g as follows: 

'Given *, start the algorithms for computing fix) and gf» 
simultaneously. (Envisage two agents or machines working 
simultaneously, or one agent who does one step of each 
algorithm alternately.) If and when one of these computations 
terminates, fhen stop altogether, and set Alx)«l. Otherwise, 
continue indefinitely.' 

This algorithm gives h(x) = 1 for any x such that either /(x) or 
g(x) is defined; and it goes on for ever if neither is defined. Thus 
we have an algorithm for computing rt. so by Church's thesis h is 
URM-computable. 
3. Lei f{n)- the nth digit in the decimal expansion of it = 
3.14159 . . . (so we have/(0) = 3 1 /(1J = 1-/(2) = 4, etc.). We can 
obtain an informal algorithm for computing fin] as follows. 
Consider Hutton's series for n 

12f. 2/1 \ 2x4/ IV* 1 

I4f 2/ 1 \ 2x4/l\ 2 
- (nil') 2 [12/1 y 14; \y\ ~ , 
Lei s* = I*-n ft « > bv lhe elementary theory of infinite series 

Now s k is rational, so the decimal expansion of s k can be 
effectively calculated to any desired number of places using long 
division. Thus the following is an effective method for calculating 
/(h) (given a number «): 



Find the first .V^n+1 such that the decimal expansion 
*m r = ao.di<i2--- a*a m .i. ..a»... 

does not have all of a n , , , a s equal to 9. (Such an ,V exists. 

for otherwise the decimal expansion of it would end in recurring 
9, making it rational.) Then put fin ) = a*? 

To see that this gives the required value, suppose that a m * 9 
with /i < m s ,V. Then by the above 

s.v<ir<s N -i;iO* 

ssn + I/HT. 

Hence d . ^! . . <?„. . .a m . . .<7r<a l) .a t . . . a„. . .(a m + \) . . . 
so the nth decimal place of t is indeed a„. 
Hence by Church's thesis, f is computable. 

The student should try to provide complete formal proofs (method 1) 
that the functions in these examples are URM-computable (assuming, for 
example 2, that f and g are URM-computable). For all of them it is a 
lengthy and tedious task. 



Note that in using Church's thesis we arc not proposing to abandon all 
thought of proof, as if Church's thesis is a magic wand which we can wave 
instead. A proof by Church's thesis will always involve proof thar is 
careful, and sometimes complicated, although informal. Moreover, any- 
one usingChurch's thesis in the way we propose should be able to provide 
a formal proof if challenged. (As if to anticipate such a challenge, we 
provide in the appendix to chapter 5 an alternative formal proof of one 
fundamental theorem in that chapter (theorem 5-1.2! on which almost all 
later development depends. This then serves to substantiate further 
Church's thesis; incidentally, it is a simple formal corollary that the 
functions in the first two examples above arc URM-computable also.) 

Church's thesis not only keeps proofs shorter, but also prevents the 
main idea of a proof or construction from being obscured by a mass of 
technical details. It remains, however, an expression of faith or 
confidence. The validity of faith depends on the evidence that can he 
mustered. In the case of Church's thesis, there is the mathematical 
evidence already outlined. For the practised student there is the addi- 
tional evidence of his own experience in translating informal algorithms 
into formal counterparts. For the beginner, our use of Church's thesis in 
subsequent chapters may call on his willingness to place confidence in the 
ability of others until self confidence is developed. 



To conclude: for the remainder of this hook, we accept Church's thesis 
and use it in the manner described above, often without explicit reference. 



7.2. Exercises 

1 . Suppose that fix) and g{x) are effectively computable functions. 
Prove, using Church's thesis, that the function h given by 

tx if x€Dom</).^Dom(iy), 

' I undefined otherwise 

is URM-computable. 

2. Suppose that / is a total unary computable function. Prove, 
by Church's thesis, that the following function h is URM- 
computable 

II ifxeRanC/), 

I undefined otherwise. 

3. Give a detailed proof by Church's thesis that the Ackermann 
function (example 2-5,5) is computable. 

4. Prove by Church's thesis that the function e given by 

gin) = nth digit in the decimal expansion of e 

is computable (where the number e is the basis for natural 

logarithms). 



Numbering computable 
functions 



We return now to the study of URM-computablc functions. Henceforth 
the term computable standing alone means URM-computable. and 
program means URM program. 

The key fact established in this chapter is that the set of all programs is 
effectively denumerable: in other words there is an effective coding of 
programs by the set of all natural numbers. Among other things, it follows 
that the class ^ is denumerable, which implies that there are many 
functions that are not computable. In § 3 we discuss Cantor's diagonal 
method, whereby this is established. 

The numbering or aiding of programs, and particularly its effective- 
ness, is absolutely fundamental lo the development of the theory of 
comparability. We cannot overemphasise its importance. From it we 
obtain codes or indices for computable functions, and this means that we 
are able to pursue the idea of effective operations involving such codes. 

In § 4 we prove the first of two important theorems involving codes of 
functions: the so-called s-m-n theorem of Kleene. (The second theorem 
is the main result of chapter 5.) 

1 - Numbering programs 

We first explain the terminology that we shall use. 

1.1. Definitions 

(a) A set X h denumerable if there is a bijection /: X -» rU 
(.Vo/e. The term countable is normally used to mean finite or 
denumerable; thus, for infinite sets, countable means the same as 
denumerable. The term countably infinite is used by some 
authors instead of denumerable.) 

(b) An enumeration of a set X is a surjection g: fy-*X: this is 
often represented by writing 



where x n = tzln J. This is an enumeration without repetitions if g is 

infective. 

(c ) Let A" be a set of finite objects (for example a set of integers. 

or a set of instructions, or a set of programs); then X is effectively 

denumerable if there is a bijection / : X -* H such that both / and 

/ ' are effectively computable functions. 

(Note. We mean here the informal notion of effectively 

computable. This is compelled on us since, in general, there is no 

available formal notion of computability of functions from X to 

W. : In cases where some formal notion does apply, we take this to 

be the meaning, as for example in theorem 1.2(a).) 

Clearly, a set is denumerable if and only if it can be enumerated 

without repetitions. 

For the main result of this section we need the following (recall that U* 
denotes the set of all positive natural numbers): 

1.2. Theorem 

The following sets are effectively denumerable. 

{a) \xfoJ. 

{b) \*xN*xN*. 

(c) Ufc>o N*, the Set of all finite sequences of natural numbers. 

Proof 

{a J A bijection tt: *£ x Fej -» ^J is defined by 

iri:m,n) = 2"'(2n + li-l. 

It is clear from the definition that tr is in fact a computable 
function ; to see that the inverse is effectively computable observe 
that Tr is given by 

ff" 1 U) = l>i(j:), TTiU)). 

where it,, ir 2 are the computable functions defined by n x {x) = 
U + l)„ ir 3 I>") = 5(u + l)/2' r ' < "-IJ. (Cf. exercise 2-4.16(2).) 
(b) An explicit bijection ^:\*x^x^'-»N is given, using the 
function ir of (a J, by 

£(m,n, q)= 7r{-rr{m — \,n - 1), q— 1). 

Then we have 

C~ l tx) = (ffjf>j(*)) - 1 . wtivM) + 1 . ffate) + U. 



' To say thai we should use a notion of computabiluy based on some coding begs 
the whole question, since a coding is an effective ;in the infot msl sense) [unction. 
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Since (he functions it. jti, it? are effectively computable. Then so 

are £ and £ ' . 

[c) A bijection r; U*>« W k -* N is defined by 

a, -a ,♦(•,»?. 



T{fl *,....**) = 2" 



-j a — u-- 



+ 2' 

i-1 



_2 a i - ••■■„'■-' _ 

Clearly t is an efTeclively computable function. To see thai r is a 
bijection, and to calculate r~ (*), we use the fact that each 
natural number has a unique expression as a binary decimal. 
Thus, given x. we can effectively find unique numbers k -• 1 and 
Qibx<b 2 ... <A fc such that 

* + l = 2"' + 2* : -... + 2 ft - 

from which we obtain 

r i>) = («i.. .. ,a k ), 

where a-, = b x and a 1+l = f>, (1 -t>,-l (lfii<fc). (Cf. exercise 
2-4.16(5). where functions closely connected with the cal- 
culation of r ' are lo be proved computable.! 

Let us now denote the set of all URM instructions by J. and the set of 
all programs by &. A program consists of a finite list of instructions, so we 
next consider Ihc set S. 



1.3. Theorem 

J is effectively denumerable. 
Proof. We define an explicit bijection 0: £-*% that maps the four 
kinds of instruction onto natural numbers of the forms 4«. 4m -*- 1 , 4a + 2, 
4u + 3 respectively; we use the functions tt and ( defined in the proof of 
theorem 1.2. 

0(Z(rt)) = 4(n-l), 
/3(S(rt)) = 4{n-I)-H. 
0(T(m, n) = 4ir(m-l,/i-l) + 2, 
£(J(m. n, q)) - 4£ (m. n.q\ + 3. 

This explicit definition shows that is effectively computable. To find 
P~ {x't, first find u, r such that jc =4«+r with 0^ /■ <4. The value of r 
indicates which kind of instruction 0~ l lx) is. and from u we can 
effectively find the particular instruction of that kind. Specifically: 

if r = 0, then 0~'U» = Z(h + 1); 

if r = 1, then £ _1 (x) - S(u + 1 ); 



i ;vumnvr;ng £iragruin\ 
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if r = 2. then /3 " 'l*l = T(in(iiH 1, *tt(ii)+ 1); 

if r = 3, then £ 'U» = J(m. 'm/i, where (m, n, ?) = f~ (tt). 
Hence $ ' is also effectively computable. G 
Now we can prove: 

1.4. Theorem 

9* is effectively denumerable. 
Proof. Define an explicit bijection y:^*-»fa as follows, using the 
bijections t and of theorems 1.2 and 1.3: if P = L,I 2 , -.../. then 

Since r and (i are bijections, so is y: the fact that t, Q and their inverses 
are effectively computable ensures that y and y ' are also effectively 
compu table. Q 

The bijection y will play an important role in subsequent development. 
For a program P. thenumbcr y{P] is called the code number of P, or the 
Gode! number of P, or just the number of P. We define 

P r = the program with i.code) number n 
= Y "(«), 
and say that P, is the nth program. By construction of y, if m & «, then P m 
differs from P r , although these programs may compute the same 
functions. 

It is of the utmost importance for later results that the functions y and 
y~ l are effectively computable; i.e. 

la) Given a particular program P. we can effectively find the 

code number y(P); 

ib) given a number n. we can effectively find the program 

P» = y V). 
In order to emphasise this we give two simple illustrations. 



1.5. Examples 

(a) Let P be the program T(l. 3), S(4j, 2(6). We will calculate 

vCP). 

/SiTil. 31) = 4«tG, 2)+2 = 4{2°C2 x 2 + 1) -1) - 2 = 18, 
0(S(4)) = 4x3 + l = 13, 

0(2(6)) = 4x5 = 20. 

2 The term Godti number :s used alter K Gudel *ho first exploited the idea oi 
coding nor -numerical object! by numbers in his famous paper iOodel f 19311). 



Hence y(/ , } = 2 l8 + 2 



32 



'-1 



= 9007203549970431. 
(b) Lei n =4127; we will find P-in?. 

4127 = 2 + 2 — 1; Ihus^ai;; is a program with two instructions 
Tu h where 
0{/i) = 5 = 4xl + |. 
£</;) -12-5-1 =6 = 4xl-2 = 4 ff (l,0) + 2. 

Hence from the definition of 0, Ii = S(2) and 7 2 = T\2, 1), so P iX2 i 
is 

S(2) 

T(2, 1 ) 

There are. of course, many other possible effective bijections from <3* to 
\: our choice in defining the details of y was somewhat arbitrary. What is 
vital, we again emphasise, is that y and y ' are effectively computable. 
The particular details of y are not so important. For subsequent theorv. 
any other bijection y would suffice, provided thai y' and its inverse are 
effectively computable. However, we have to fix on one particular 
numbering of programs, and we have chosen that given by y. For the rest 
of this book, y remains fixed, so thai for each particular number n. the 
meaning ofP„ does not change. Thus, for instance, P 4m always means the 
program S(2), T(2, 1). 

1 .6. Exercise 

Find 

{a) 0(J(3,4,2V). 

(c) the code number of the following program: 

T(3,4),S(3.>,Za.>. 

id) Pim, 



2. Numbering computable functions 

Using our fixed numbering of programs, we can now number 
computable functions and their domains and ranges. We introduce some 
important notation which is basic to the rest of the book. 

2.1. Definition 

For each a € %J, and n -v 1 : 



£ ifumoert'ig iunif/uinun /««*■»«/«» 



(d J **>'a = tnc n-axy function computed by P« 
= /"jT 1 in the notation of chapter 1 § 3, 
Kb) Wl" 1 = domain of #" w {<*i P *•■): *>.(*!>.< ■» *«)#■ 



£» = range of $ 



■■I 



We shall be mainly concerned with unary computable functions in later 
chapters, so for convenience we omit the superscript (1) when it occurs; 
thus we write &, for <£ u ", W a for W", and F 3 for E' a '. 



2.2. Example 

Le( a = 4127; from the previous section we know that /Y27 is 

S(2},T(2, 1). Hence 

<*4I27U) = 1 Wlr) 



and 



Tnus 






*i x*) = x 2 -l 



if u>l. 



W 4l7 , = U, E 4127 = {1), 
W$$a=*tf t SS&-N* if">l- 
Suppose that f is a unary computable function. Then there is a program 
F, say, that computes/; so / = © , where a = yiPl Wc say then that a is an 
index for/. Since there are many different programs that compute a given 
function, we cannot say that a is the index for/; in fact, each computable 
function has infinitely many indices. 

Wc conclude that every unary computable function appears in ihe 
enumeration 

<bf.,<b\. 4>2 

and that this is an enumeration with repetitions. 
Similar remarks apply to rt-ary functions and iheir enumeration. 

2.3. Exercise 

Prove that every computable function has infinitely many 
indices. 

Recall that we denoted the set of all n-ary computable function by tf„. 



2.4. T}\eorem 

%. is denumerable. 



iiumwrirtx lU/n(iUtUI>lg functions 



IS 



J I nt diagonal memua 



Proof. We use the enumeration <!>£', <f>T\ d>'{\ . . . (which has repeti- 
tions) to construct one without repetitions. 



Lei 



f(m - 1) = /aW * *$,, .... £$,»). 



TliL-n 



till iL 
tpfy.t,. iff 



■int 



is an enumeration of <%„ without repetitions, d 
Note. We are not claiming that /as defined in this proof is computable; in 
fact, we will be able to show later that this is not the case. It is possible, 
nevertheless, to give a complicated construction of a total computable 
function h such that #{01, *Si„ . . . is an enumeration of '4 r without 
repetitions. This was proved by Fricdberg [19581 



2.5. Corollary 

*€ is denumerable. 

Proof. Since ^ = U«*i *m this follows from the fact that a denumer- 
ablc union of denumerable sets is denumerable. 

Fxplicitly. for each n let/,, be the function used in theorem 2.4 to give 
an enumeration of < ^„ without repetitions. I .et rr be the bijection f$ x *y -» 
N of theorem 1 2. Define 6\ % •* N by 

Oearly # is a bijection. 3 



Since / differs from every unary computable function £„, / does not 
appear in the enumeration of «i and is thus not itself computable. Clearly 
/is total. Z| 

3. Discussion: the diagonal method 

The method of constructing the function f in theorem 2.6 is an 
example of the diagonal method of construction, due to Cantor. Many 
readers will be familiar with this method as used in proofs of the 
uncountabiiity of the set of real numbers. The underlying idea is appli- 
cable in a wide variety of situations, and is central in the proofs of many 
result concerning computability and decidability. 

To see why the term diagonal is used, consider again the construction 
of / in theorem 2.6. Complete details of the functions <6 C , (*i, ... can be 
represented by the following infinite table: 










Won 


*o(D 


*o(2) 


■M3) 


<ft,(0) 


{£o)) 


<M2) 


4.(31 


* 2 (0} 


fed) 


(&5j 


* 2 (3) 


*,(0) 


*S0) 


$>a> 


\*m 



The next theorem shows that there are functions that are not compu- 
table. The idea of the proof is as important as the result itself. 

VJO ^2.6. Theorem 

There is a total unary function that is no: computable. 
Proof. We shall construct a total function / that is simultaneously 
different from every function in the enumeration dc.^i- <*:- . ■ - of %\. 
Explicitly, define 

fi ._(*i("-> + l if 4>An) is defined. 

10 if ^Ifl) is undefined. 

Notice that we have constructed/ so that for each n. /differs from <£., at n : 
if <K in) is defined, then /differs from 4> r in that /in ) * 4> P \n J; 
if <*„ In ) is undefined, then / differs from S„ in that fin } is defined. 



We suppose that in this table the word 'undefined' is written whenever 
<*t^imi is not defined. 

The function / was constructed by taking the diagonal entries on this 
table (circled) 

<M0),<M1;,<^2),... 
and systematically changing them, obtaining 

/(ovm.rm... 

such that /iVi differs from <*„<«), for each n. Note that there was 
considerable freedom in choosing the value of/(n); we only had to ensure 
that it differed from #„(«). Thus 

._[<£„(«> + 27" if <M«) is defined, 
\n z if #„(« I is undefined. 

is another non-computable total function. 



■ *■ '*■»<. ■ I ■ ' - 



We can summarise the diagonal method as we shall be using it, in the 
following way. Suppose that^o.^i.^a. - ..is an enumeration of objects of 
a certain kind (functions or sets of natural numbers). Then we can 
construct an object \ of the same kind that is different from every \n. 
using the following motto: 

'Make x and x- differ atti.* 

The interpretation of the phrase differ at n depends on the kind of object 
involved. Functions may differ at n over whether they are defined, or in 
their values at n if defined there ; with functions, there is usually freedom 
to construct x so as to meet specific extra requirements; for instance, that 
X be computahlc, or thai its domain (or range) should differ from that of 
each x»- 

In the case of sets, the question at n is whether or not n is a member. 
We illustrate the diagonal construction when sets are involved. 

3.1. Example 

Suppose that A , A u A 2 , ... is an enumeration of subsets of N. 
Wc can define a new set B, using the diagonal motto, by 

n eB if and only if n£A K . 
Clearly, for each »i, B * A r . 

There arc important applications of the diagonal method in the next 
two chapters. 

3.2. Exercises 

1 . Suppose that f\x, yj is a total computable function. For each m, 
let g m be the computable function given by 

g„iv] = /{m,y>. 

Construct a total computable function h such that for each m. 
h * g m . 

2. Let/0,/1, . . .be an enumeration of partial functions from \l to W. 
Construct a function g from K to H such that Domlg I *• Dom{/j 
for each i. 

3. I .el/ be a partial function from f*4 to N, and let m s M. Construct a 
non-computable function g such that 

g(x)=*f(x) fwxsm. 

4.t«) (Cantor) Show that the set of all (unctions from ty to fa is not 
denumerahle. 






ib) Show that the set of all no n -computable total functions from 
fcj to M is not denumerable. 



4. The s-m-n theorem 

In the final section of this chapter we prove a theorem that has 
many important uses, especially in conjunction with the main theorem of 
the next chapter. 

Suppose that fix, y) is a computable function (not necessarily tQtal). 
Then for each fixed value a of x, / gives rise to a unary computable 
function g„, where 

g a {y)~f{a, yl 

Since g,, is computable, it has an index e, say. so that 

The next theorem shows that such an index e can be obtained effectively 
from a. This is a particular case of a more general theorem, known as the 
s-m-n theorem, which we prove below. (The reason for this name will be 
explained after theorem 4.3.) For most purposes in this hook, the 
following suffices. 

4.1. Theorem (The s-m-n theorem, simple form) 

Suppose thai f(x, y> is a computable function. There is a total 
computable function k lx) such thai 

f(x, y)^<**«>(y)- 
Proof. For each fixed a, fc(a) will be the code number of a program Q„ 
which, given initial configuration 



R 



(*) 







computes f[a, y). 

Let F be a program that computes f. Then for Q* wc write down F 
prefaced by instructions that transform the configuration (*) to 

R, R 2 



rumoenng conipuiaoie functions 



fi^ 



Thus, define Q* to be the following program 

TU.2) 
Z(l> 

fso> 



a times < ■ 

isa) 

F 
Now define 

kta) = ihe code number of the program Q a . 
Since F is fixed, and from the fact that our numbering y of programs is 
effective, we see thai k is an effectively computable function. Hence, by 
Church's thesis, k is computable. By construction 

4>kiai(y)-fta, y) 
for each a. D 

The s-m-n theorem is sometimes called the Paiametrisation theorem 
because it shows that an index for a computable function (such as g a in the 
discussion above) can be found effectively from a parameter isuch as a ) 
on which it effectively depends. 

Before giving the full s-m-K theorem we give some simple illustrations 
of the use of theorem 4.1 in effectively indexing certain sequences of 
computable functions or their domains or ranges. 

4.2. Examples 

1. Let /(*, y! = y'. By theorem 4.1 there is a total computable ft 
such that d> klr ,iy) - y . Hence, for each fixed n, k [n ) is an index 
for the function y". 

fy if v is a multiple of x 

2. Let/(x,y) = 4 

{undefined otherwise. 

Then /is computable, so let k be a computable function such that 

«£*;.■(>') **[(** y)- Then, for each fixed n 

0Wn)(yl is denned iff y is a multiple of n 

iff y is in the range of <£*<■,). 
i.e. 

W t „, = fiiM { = ihe set of all multiples of n) 

So we have an effective indexing of the sequence of sets (nf*J)as 
(i) the domains of computable functions. <ii) the ranges of 
computable functions. 



One obvious way to generalise theorem 4.1 is lo replace the single 
variables x. y by m- and n-tuples x and y respectively. We can also reflect 
the fact that the function k defined in the proof of theorem 4.1 depended 
effectively on a particular program for Ihe original function /. Thus, 
instead of considering a fixed computable function fix. y) we consider a 
general computable function ^r*"'(x, y), and the question of effectively 
finding, for each e and x, a number z such that 



4.3. Theorem (The s-m-a theorem! 

For each m.n'^l there is a total computable [m + l)-ary function 
s"ie,x\ such that 



Proof. We generalise the proof of theorem 4.1. 
For anv i £ 1 let Q{i. x) be the subroutine 



ZU) 
Stf) 



x limes 



Si."i 



that replaces the current contents of R, by x. Then for fixed m, n define 
s^'le, x'i to be the code number of the following program: 






Tirt, m + n) 

T(2, m-2) 
T(l t m + 1) 

QU,*d 

0(2, x 2 ) 

Qim,x m ) 
P< 



This part of the program transforms any configuration 
R, R, 



•■i 



i: 



i") 



into 
R. 



K m K. 



R.„. 



*i 



yi 



-i 



From this explicit definition, and Ihe effectiveness of y and y , we get 
that i* is effectively computable, hence computable, by Church's 
thesis. 13 



The notation s» for the function given by theorem 4.3 has given rise to 
the standard description of this result as the s-m-n theorem . We will also 
use this name to describe the simpler version given in theorem 4.1. 

It is not hard to see that the function s" as defined above is in fact 
primitive recursive. With a little thought it is also possible to see that for 
each m there is a function s m (also primitive recursive! that suffices in 
theorem 4.3 for all n. See the exercises 4.4(51 below. 



4.4. Exercises 

1 Show that there is a total computable function k such that for 
each n, k(n) is an index of the function [CVj. 

2. Show that there is a total computable function k such that for 
each n, W K ,„- = the set of perfect »iih powers. 

3. Let n 2:1. Show that there is a total computable function s such 
that 

4. Show that the functions s* defined in theorem 4.3 are all 
primitive recursive. 

5. Show that for each m there is a total im — l)-ary computable 
function s™ such that for all n 

where x, y are m- and »r-tuples respectively. 
[Him. Consider the definition of sZie.x) given in the proof of 
theorem 4.3. The only way in which n was used was in determi- 
ning how many of the r 1( r 2 , . . . to transfer to /?,„_), R m +2, 

Now recall that the effect of P. depends only on the original 
contents of R ( . . . . , Rpijy, where p is the function defined in 
chapter 2 § 2: plP..) is independent of n.) Show r further that there 
is such a function s" that is primitive recursive. 



Universal programs 



In this chapter we establish the somewhat surprising result that there are 
universal programs-, i.e. programs that in a sense embody all other 
programs. This result is one of the twin pillars that support computability 
theory tihe other is the s-m-n theorem): both rest on the numbering of 
programs given in chapter 4. 

Important among the applications of universal programs is the 
construction of specific non -computable functions and undecidable 
predicates, a topic pursued in chapter 6. We give a foretaste of such 
applications in § 2 of this chapter; we also use a universal program to 
construct a total computable function that is not primitive recursive, as 
promised in chapter 3. 

The final section of this chapter is devoted to some illustrations of the 
use of the s-m-n theorem in conjunction with universal programs to show 
that certain operations on the indices of computable functions are 
effective (a foretaste of the topic of chapter 10i. 



1. Universal functions and universal programs 

Consider the function ti/{x, y) defined by 

There is an obvious sense in which the single function & embodies all the 
unary computable functions &>. 4>i, <*?. • • . since for any particular m, 
the function g given by 

g(y)^t!/{m. y) 

is just the computable function <b m . Thus we describe <!< as the universal 
function for unary computable functions. Generally, we make the 
following definition. 



1.1. Definition 

The universal function for n-ary computable functions is the 
in -t-lt-ary function O'u' defined by 



We write &r for *B\ 

The question arises, is tfnj (or. generally, i£u ' ) a computable function? 
If so, then any program P (hat computes i^u would appear to embody all 
other programs, and P would be aptly called a universal program. At first, 
perhaps, the existence of a universal program seems unlikely. Neverthe- 
less, it is not hard to see that c*u is indeed computable. The point is thai a 
universal program P does not need to contain all other programs P r in 
itself; P onlv needs the ability to decode any number e and hence mimic 
P.. 

1.2. Tlieorem 

For each n. the universal function i^* is computable. 

Proof. Fix n, and suppose that we are given an index e and an rc-tuple *. 
An informal procedure for computing <f-u'ie, x) is as follows: 

^Decode the number e and write out the program P.-. Now mimic the 
computation P.txl step by step, at each step writing down the configura- 
tion of the registers and the next instruction to be obeyed (as was done in 
example 1-2.1). If and when this computation stops, (hen the required 
value 0u {e,x) is the number currently in R|." 

We could conclude immediately (using Church's thesis) that ifru ('■- *) ' s 
computable. Because of the importance of this theorem, however, we 
prefer to outline the beginnings of a formal proof and then make a rather 
less sweeping appeal to Church's thesis. (For the sake of completeness of 
our exposition we shall provide the rest of the formal proof in an appendix 
to this chapter.) 

The plan for a formal proof is to show first how to use a single number a 
to code the current situation during a computation: then we show that 
there is a computable function expressing the dependence of «r on \a ) the 
program number e, (b) the input x, ic) the number of sieps of the 
computation thai have been completed. We will see that this suffices to 
prove the theorem. 

Let us return, then, to the computation P r lx> considered above. As we 
have seen in examples, the current situation during a computation is 
completely specified by (i) the current configuration of the registers 










r rii r 3 . and (iil ihe number / of the next instruction in the compu- 
lation. Since only finitely many of the numbers r, are not zero, the current 
configuration can be specified by the single number 

.c=M „=l]p?. 

.Recall that /?, is the rth prime number.) We call this number the 
configuration code or just the configuration if there is no ambiguity. Note 
that the contents r, of R, can be easily recovered from c; in fact r : = |c). 
(using the function of theorem 2-4. 15(d)). 

The complete description of the current situation can now be coded by 
the single number a = iri.c, j). which we call the current stale of the 
computation P r (x). (Here rr is the pairing function used in the proof of 
theorem 4-1.2.) We will make the convention that if the computation has 
stopped, then /' = and c is the final configuration- Note that c = irilrr) 
and i = tT2{o') where wu t 3 are the computable functions defined in 
theorem 4- 1.2. 

Now c, i, tr change during the computation; their dependence on the 
program number e, the input x and the number r of steps completed is 
expressed by defining the following {n + 21-ary functions: 
(1) c n {e, x, t) — the configuration after / steps of 

P r ixi have been completed 
( = the final configuration if Pax)1 in t 

or fewer steps). 

the number' of the 
next instruction for 



(2) 



(3) 



/„(*,*,(>= P,U) when r steps 

have been completed, 



if P,(x)has 
not stopped 
after / or 
(ewer steps. 







if P,(x)l in / or fewer steps. 



o- r {e,x, rl = the slate of the computation P,(x> 
after t steps 
= ir(c„(e, x, t), t„(e, x, ()). 

The aim now is to show that «r r land hence e„ and /„ I are computable 
functions. To see why this is sufficient, suppose that this has been done. 
Clearly, if the computation P,(i) stops it docs so in ^l{J J ,{e J X, r) = 0) 
steps; then the final configuration is c n (e, x, ntij„ie, x, t) = 0», and so wc 

" We meat here the number/ such that the next instruction/ is the fth instruction 
of P,\ we do nor mean the code number £{!>. 



- — ~. 



l universal junctions ana universal [/rugrums 



Of 



have 



<bv'U,x)-{c n (e,x,mlh<e,x,t)^0))h. 



Thus, if c„ and /,, arc computable, so is &[? (using substitution and 
minimalisationl and our proof is complete. 

We now use Church's thesis to show that y\, (and hence c, and/„) are 
computable. Wc have the following informal algorithm for obtaining 
tr*ie,i, f + 1) effectively from ir„{e, x, t) and e : 

'Decode cr„ («*,*,/) to find the numbers c = c„(e, x, f) and/ = j n (e, x. t). 
If y'-O, then <r n ie,x,t + l) = a„le,x, t). Otherwise, write out the 
configuration coded by c, 



(*') 



c-ii (ck 



[0 3 



[C). 



U 







say, and by decoding e write out the program P r . Now find the /th 
instruction in P f and operate with it on the configuration (*), producing a 
new configuration with code c say. Find also the number /" of the new 
next instruction (with f = if the computation has now terminated). Then 
we have 

0Vte,jr 5 !-t-l) = sT(r\/'). 

This shows informally that <r n (e, x, t ) is computable by recursion in r, since 
for r = we have 

ffj ,(^ ) 0) = ri2 , '3"...pl",l) 

to start the recursion off. Hence, by Church's thesis. <x n is computable. 
and our theorem is now proved. 3 

Note. Since this theorem is so basic to further development, wc provide 
in the appendix a complete formal proof that it, (and hence cv'u') is 
computable. This then provides further evidence for Church's thesis. 
(Our formal proof also gives us the extra information that a n is actually 
primitive recursive.) 
From the proof of this theorem we obtain: 

1.3. Corollary 

For each ft al, the following predicates are detidable. 

(a) S„{e,x,y, t) ** P r {x) I y in t or fewer steps', 
lb) H„(e, x, /)■ 'P,[x')i in tor fewer steps' - 

Proof (a) S n (e, x, y, t) = 'f\(e, x,t) = and (c,i>, x. /)}, = y'. 

(b) HJ,e,x.i} = 'iJe,x,t) = 0'. □ 



C| 






The significance of the next corollary is discussed in the first note 
below. 

1.4. Corollary (Kleene's normal form theorem) 

There is a total computable function U(x) and for each n a 1 a 
decidable predicate T r {e.x,z) such that 

(a) ^["'ix) is defined if and only if 3zT n {e.x,z), 

ib) <i>i"'ix) -' Vijiz T n ie, x, z)h 
Proof. To discover whether $'," '(* lis defined, and the value if it is, we 
need to search for a pair of numbers y, f such that S K ie,x, y, r). We have 
the ^-operator that enables us to search effectively for a single number 
having a given property. To use this in searching for a pair of numbers, we 
can think of a single number z as coding the pair of numbers tz h and (2)2- 
Then, as z runs throughly, the pair (U)i, {2)2) runs through f^xU So we 
define 

T n (e, x,z)'=S H {e t x, (zU. (zh)- 
For (a), suppose that tf> l J"(x) is defined: then there are y, t such that 
S n {e, x. y, /). so putting z = 2' 3' we have T„(e. x, z). 

Conversely, if there is 2 such that T„ ie, x, z ), then from the definition of 
T m P e ix)i; i.e. <p< e "''ix) is defined. 

For (K it is clear from the definition of T„ that if £?'{*) is defined, 
then for any 2 such that T„le,x,z),we have <^" ! U) = (2>i. So if we put 
Uiz) = (z)i then 

<t>\r lx)=UinzT n ie.x,z)). D 

•Votes 

1. From the appendix to this chapter it follows that the functions c„ 
and /„ are primitive recursive. Hence, the predicates S„, H n , T„ in 
corollaries 1.3 and 1.4 are also primitive recursive. Thus, in particular, 
the Kleene normal form theorem shows that every computable function 
(or partial recursive function) can be obtained from primitive recursive 
functions by using at most one application of the y-operator. The 
theorem gives, moreover, a standard way of doing this. 

2. The technique of searching for pairs of numbers by thinking of a 
single number 2 as coding the pair (2):, [zh las used in the proof of 
corollary 1 .4) is often used in comput ability theory. We give an exercise 
needing this technique below (exercise 1.5(1)). 

The technique can also be used in searching for sequences 
Ui,*2, .. . ,x„)for any/i>l. 
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1.5. Exercises 

1- (ij Show that there is a decidable predicate Q{x, y. z) such lhat 
{a) yeE, if and only if 3; Qyx, y, z), 
(b) if y € E„ and Q(jr, y, z) s then <MU)i) = >•. 
(ii) Deduce lhat there is a computable function g[x. y.i such that 
{a ) g( x, y ) is defined if and only if y € E x . 
(b) if y e E x , then gU. >') e W x and & IgU, y)) = y : i.e. gix, y) £ 

<*;'((>»). 

(iii) Deduce lhat if / is a computable injective function (not 
necessarily total or surjective) then f~ l is computable, (ef. exer- 
cise 2-5.4 (IJ). 
2. (cf. example 3-7.1(2)) Suppose that/ and g are unary comput- 
able functions; assuming that T t has been formally proved to be 
decidable. prove formally that the function hix) defined by 

1 if x e Dom</) or x € Domini, 
.undefined otherwise, 
is computable. 



fcfr) = 



2. Two applications of the universal program 

We illustrate now the use of the computability of universal functions in 
diagonal constructions. This kind of application will be explored more 
thoroughly in the next chapter. 

2.1. Theorem 

The problem '<*t, is lotai' is undecidable. 
Proof. Let g be the characteristic function of this problem; i.e. 

1 if <6 C is total, 
.0 if «* t is not total. 

We must show that g is not computable. To achieve this, we use the 
diagonal method to construct a total function / that is different from every 
computable function, yet such that if g is computable, then so is f. 
Explicitly, define / by 

+ 1 if <*, is total, 
if S x is not total. 

Clearly, / is total and differs from every computable function <*>„ Now. 
using e and t!> v we can write / as follows: 



gix 



/u>=ir ! 



«-(** 



x)+l ifgU) = l, 
if gix) = 0. 









Now suppose that g is computable; since i^u is computable, then, by 
Church's thesis, so is /, which is a contradiction. Hence g is not 

computable. D 

Our second application here fulfils the promise made in chapter 3 § 3. 

2.2. Theorem 

There is a total computable function that is not primitive recursive. 

Proof. We give an informal proof. Recall that the primitive recursive 
functions are those functions that can be built up from the basic functions 
by a sequence of applications of the operations of substitution and 
recursion. Thus each primitive recursive function can be specified by a 
plan that indicates the basic functions used and the exact sequence of 
operations performed in its construction. To describe such a plan it is 
convenient to adopt some notation such as the following: 

Sub(/: g ( , g 2> » gm) denotes the function obtained by substituting 

gi, . - • . g*> into / (assuming lhat / is m-ary, and g\. . . . , g m are /t-ary for 
some «■).; 

Rect./, g\ denotes the function obtained from / and g by recursion 
(assuming that / is n-ary and g is {n + 2)-ary for some n ). 

If we write S for the function x + 1, then we have, for example, the 
following plan for the function f{x) = x'. We use letters gi r . . - ,g* to 
denote intermediate functions. 

Explanation of the steps 



Plan 

Stepl. ^ = Sub(S;U|». 



g,U. y, z ) = U 3 (x, y, z) + 1 = z + 1. 



Step 2. g 2 =Ree(Ui,g,!. 



■ • 



Step 3. g3 = Sub(g 2 ; L'i 
Step 4. g* = Reci'O, g 3 ). 



Vl). 



g2(x,0) = V[(x) = x, 
.g 2 {x, y + 1) = g\{x, y, g 2 U, y» 

= g 2 <* 1 y) + l. 
Sogj'.x, y) = * + >'. 
g 2 tx, y,z) = g 2 {x, z) = x +z. 

[g4<*.o;i=o, 

lg4<x, y + U = frU. y. g*ix, y» 

= x+g 4 U,y\. 
So g 4 (x, y) = xy. 
fU) = gtlx,x)=x 2 . 
Thus a plan is somewhat akin to a program, in that it is a finite and explicit 
specification of a function. 

We now restrict our attention to plans for unary primitive recursive 
functions. As with programs, we can number these plans in an effective 



StepS. /=Subl«4:L'!.Ui). 



I ■ -ill f//l/VIU«H 
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way. so thai we may then define 

0„ = the unary primitive recursive function 
defined by plan number n. 

Then tt v . (9|, ft*;. . . . is an effective enumeration of all unary primitive 
recursive functions. 

From chapter 2 we know that every primitive recursive function is 
computable. Hence there is a total function p such that for each n. pin 1 is 
the number of a program that computes d„ ; i.e. 

Now the crucial point is that we can find such a function p that is 
computable. We argue informally using Church's thesis. 

Recall the proofs of theorems 2-3.1 and 2-4.4. There we showed 
explicitly how to obtain a program for the function 

Sub(/;s, g m ) 

given programs for /, gi ..... g„ ; and also, how to obtain a program for 
the function 

Reef/,*) 

given programs for /and %. (In the next section (example 3.1(5)) we use 
the s-m-n theorem to show in detail that t*6r each « there is a computable 
function r such that for any f|,c; an index for Reci.^^'. $** lis given by 
r(e\, e 2 )\ we can do a similar thing for substitution (see exercise 3.2(Sa )).) 
We also have explicit programs for the basic functions. Hence, given a 
plan for a primitive recursive function / involving intermediate functions 
gi» • • - > gt- say. we can effectively find programs for gitgz,,.., gt, and 
finally /. Thus there is an effectively computable function p such that 

By Church's thesis, p is computable. 

Now for the payoff! Fromp and the universal function (fo ( we can define 
a total computable function g that differs from every primitive recursive 
function 0,. We use a diagonal construction as follows: 

g(x) = 9Ax) + \ 

= <£„«»(*) + 1 

= <M/>U), x)+l. 

From this we see immediately that g is a total function that is not primitive 
recursive; but g is computable, by the computability of tfa and p. □ 



3. Effective operations on computable functions 

In this section we illustrate another important application of the 
computability of the universal functions, this time in conjunction with the 
s—tn—ii theorem. 

Consider the following operations on computable functions or their 
domains: 

la) combining 4>x and <£ v to form the product d>,<b., ; 

ib) forming the union W, <j U\ from IV, and W v . 
We are all familiar with a wide variety of operations of a similar kind, 
usually defined explicitly like these. Is there any sense in which these 
operations can be thought of as effective operations? Inasmuch as these 
are operations involving infinite objects (functions or sets), they seem to 
lie outside the scope of even our informal notion of computability, which 
implicitly applies only to finite objects. Nevertheless, we will see, for 
instance, that an index for the function d> 1 4'- l ean be obtained effectively 
from the indices x,y. In the following examples and exercises we see that 
many other operations are effective when viewed thus as operations on 
indices of the objects involved. I We will return to the topic of effective 
operations on functions in chapter 10.) 



3.1. Examples 

1 . There is a total computable function six, y) such that for all x, y 

0«;..>i = «*<■*«■ 

Proof. I.CI fix, y,z) = ^ I (z)tp,{z) 

Thus f is computable, so by the s-m-n theorem there is a total 
computable function six y) such that/tx y, z) = «£, (1 ,,. ( (r); hence 

2. Taking g{x) = six,x), with s as an example 1, we have {&,)" = 

3. There is a total computable function six, yl such that 

(I if z € W x or 2 s W„ 

undefined otherwise. 
By Church's thesis and the computability of <foi./ is compu- 
table; so there is a total computable function s(x,y) such that 
fix, y, z)^4>,., y ,{z). Then clearly »',„.,,= W, u W y . 



Proof. Let/(.t,y, z') = \ 






t^illl-Ci^lil f.''VJi'l*tll* 
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4. Effectiveness of taking inverses. I.et g(x,y) be a computable 
function as described in exercise 1.5; i.e. such that 

{a) g(x, y) Is defined if and only if y c E„ 

ib) if y e £",. then g(..v, > ) 6 VV' X and <f> x (g[x, y)) = y. 

By the s-m-n theorem there is a total computable function k 

such that g{x, y>~- cV, 00- Then from (a) and ib) we have 

{a') W k , t , = E K , 

(ii) if ye£„ then c\lcV<..iy)) = y. 
Hence, if 0» is injective, then &t t ui' s *'fr* and £«..r = VV,. 

5. Effectiveness of recursion. Let x = {xi x» I and consider the 

in + 3)-ary function /"defined by 

/*>*, L' 2 . x, y - 1) -<p'^ 2, ix, y, f(*i, * 2 , x, y». 

Then using the universal functions qfru and iii'-j "' to rewrite the 
expressions on the right, this is a definition by recursion from 
computable functions, so f is computable. Moreover, for fixed e% , 
e> the function glx, y)=/iei,?2, x, y) is the function obtained 
from <*>'," and &£ J by recursion. 

By the v-n?-/i theorem there is a total computable function 
r(f |, c 2 ) such that 
<» ^.<*.y >=/<«.. <- : ,*.y). 

Hence r(ei, ej) is an index for the in + l)-ary function obtained 
from 4>?l and d>''~ 2> by recursion. In the notation of theorem 2.2 

for all ifi, e 2 . 

The following exercises give more examples of the use of the s-m-n 
theorem in showing that operations are effective on indices. 

3.2. Exercises 

1 . Show that there is a total computable function k (e) such that for 
any e, if <t>< is the characteristic function for a decidable predicate 
M(x), then <t/ kle , is the characteristic function for 'not M(xY. 

2. Show that there is a total computable function k(x) such that for 
every x,£t w « H',. 

3. Show that there is a total computable function six, y) such that 
for all x. >,£,„., =E x uE r . 

4. Suppose that fix ) is computable; show that there is a total 
computable function ki.x) such that for all x, "/&;«•• = / "(W,). 






5. Prove the equivalent of example 5 above for the operations of 
substitution and minimalisation, namely: 
(a) Fix m,n2l| there is a total computable function 
s[e, fi, - . .,e m ) such that tin the notation of theorem 2.2) 

*& ,,» = Sub<<>r ; *& *£ #£?), 

ib) Fix t^l; there is a total computable function k(e) such that 

tor all e, 

6 k %ix)^ t iy[<i> , r l, ix,y) = i)). 

(We could extend the notation of theorem 2.2 in the obvious way 

and write $ x ",\, - Min(#«* + ).) 



Appendix 

Computability of the function ir„ 

In this appendix we give a formal proof that the function a n 
defined in the proof of theorem 1.2 is computable ;in fact, primitive 
recursive) thus completing a formal proof of the computability of the 
universal function ifrti . 



Theorem. 

Tlie function cr B ts primitive recursive. 

Proof, For the definition of o-., and the functions c„ and /„ coded 
by f7„, refer to the proof of theorem 1.2. 

We define twi> functions 'coring 1 and "nxf that describe the changes in 
C and /„ during computations. Suppose that at some stage during 
computation under P, the current state istr = srk,/), and suppose that/*, 
has s instructions. We can describe the effect of the /th instruction of P, on 
the state a by defining 

I the new configuration 
after the /th instruction if 1 < / < s, 
of P e has heen obeyed, 

c* otherwise. 

the number of the next if 1 s/s s 

instruction for the and this next 

computation, after the instruction 

nxilA rr) = rth instruction of P e has exists in P e . 
been executed on the 
configuration c, 

otherwise. 



config(>,«T> = 



■ ':i : iv.uii 



/•'•'(£"*"*■) 
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Now <r„ caa be obtained from config and nxt by the following recursion 
equations: 

<r H U, x, t + 1 ) = srlconfigt>, <r H (e. x, r|), nxN>, tr„ le. *, r»). 

Thus, fr„ is primitive recursive if config and nxt are primitive recursive; wc 
proceed to show that they arc. 

We must be careful now to distinguish between the code number pit) 
of an instruction / and its number in any program in which it occurs (i.e. 
the number / such that / is the /th instruction). We will always use (he 
term code number when 011) is intended. 

It is sufficient to establish that the following four functions are primitive 
recursive: 



(li 

(2) 

(3) 



In(et = the number of instructions in program P e ; 
gn!e,/) = 



Ihe code number of the /th 

in*.tTuetion in /*,. if l^/£ln(c), 







otherwise; 



•A) 



chic, 2 ) = the configuration resulting when the 
tonfiguration c is operated on by the 
instruction with code number z: 



the number/ of the 
next instruction for the 
computation* when the 
configuration c is operated on 
by the instruction with code 
2, and this occurs as the 
/th instruction in a program. 



p{c.i,z\=> 



■:.' 



if/>0. 



otherwise 



(The next instruction for the computation' here is as defined in chapter 1 
§ 2, so /' = / + ! or, if /, is a jump instruction J(mt, ftz< <j'> we may have 

/ = <?■) 

If these four functions are primitive recursive, then remembering that 
<r = ir(e, /) where c =» vx{tr) and / = jtWit) wc have 



configtc, <r) = 



|'chi.7r,(y),gnle, 7r;(w») it 1 <n*2f<7)^ln(r)- 
l.jritfl") otherwise. 









nxtle, (t)= if this number is=£ln(e). 

i.0 otherwise. 

Thus config and nxt are primitive recursive, by the methods of chapter 2. 

It remains to show that the functions i.lM4t above are prmitive 
recursive. A sequence of auxiliary functions is needed to decode the code 
numbers of programs and instructions. We use freely the standard 
functions and techniques of chapter* §§ 1-4. together with the functions 
defined in chapter 4 § 1 for coding instructions and programs. 
(51 The functions a (/, x), t{x),b(i, x) and a </, x) of exercise 2-4. 1 6(5) are 
primitive recursive. 

Proof, ti) *=EHa a Cv*)2*; so we have qt(2\x) = aii,x)+ 
a{i + 1,jc)2 +. . and hence a(i, x) = rm(2, qt(2'. x)). 

• ii) hx l = number of is such that a'J, x)= 1; hence 

fiii) If x>0. ^ = 2 h:, •' ) -2 M:! • ,, + ...-2 fcf! "" , : thus, if \s.is.l(x). 
then bU\x) is the /th index k such that aik,x) = 1. Hence 

if L£ (£/(*) and x>0, 

otherwise. 



tiy<x{ I aiX x) = i 




(iv) From the definition: 

Gli,x) = bli,x) U = 0A) 

a(i -*- 1, *) = (A(i +1. jc)— A(/, x))-\ (*a 1) 

From the above explicit formulae, using the techniques of chapter 2. 
these functions are all primitive recursive. 

(6) The functions Inle) and gn{e, /} are primitive recursive. 
P^oof. From the definitions of the coding function >: 

ln(e) = lie + 1). 
gnk, ji = a{f,e + l), 
where i and w are the functions in (5). 

(7) There are primitive recursive functions u. Wi, Ui. V\, V2, t'.i such that: 

if i=0[Z(m)), then u[z) = m, 
if z = 0tSlm J), then h(z}= m, 
if 2 =^(T[/nj,m2)),then «iU) =! '"i and 1*2(2) =W2i 
if 2 = 0(JOni.m 2 .a)), then t'iU> = »iii 1^(2 l = m 3 , 
and V3U) = q. 






ixititvAMi fv&it*m> 
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Proof. From the definition of 0, and writing (2/4) for ql|4. z), take 
u(2) = (z/4)+ 1, 
u,(z) = iriiz/4) + l t 

i'i(2) = ffi(7r,(>/4»+l, 

t2(2) = 1T2lir l U/4))+l, 
t' 3 (2) = 7r 2 (2/4) + l. 

(8) The following functions are primitive recursive: 

(i) zeroi.c. rn I = the change in the configuration c 
effected by instruction Z(m ), 
= qt(pS : -.c). 

(ii) suc(e, m J = the change in the configuration c 
effected by instruction Slnt), 

(iii) transferfc, m, n ) = the change in The configuration c 
effected by instruction Tim, n), 
=qt(p?\cpSH 

(9) The function chic 2) (defined in (3) above) is primitive recursive. 
Proof. 

zero(c, mU)} if rm(4. 2> = 0(.i.e. 2 

is the code of a 
zero instruction). 

suctc u(z)) if rm(4, 2) = 1 (i.e. z 

is the code of a 
successor instruction.), 

transfer(c, u-Sjz), u 2 (z )} if rm(4, z ) = 2 (i.e. z 

is the code of a 

transfer instruction), 



ch(c,2l = 



.c 



otherwise. 









{10) The function v(c.j,z) (defined in (4) above) is primitive recursive. 
Proof. We have 

1 ifrm(4.2)?*3 

(i.e. z is the 
code of an 
arithmetic 
instruction), 



v(e r j.z)-' 



/ + ! Kfc). a(l t**U)«bi 



v 3 (z) if ic) v , (tt = {c) vxKz , 



if rm(4,2) = 3 
lie. z is the code of 
a jump instruction). 



From this definition by cases, we see thai v is primitive recursive. 

We have now shown that the functions (1H'4) above are primitive 
recursive, so the proof of the theorem is complete. D 
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Decidability, undecidability and 
partial decidability 



In previous chapters we have noted several decidable problems, but so far 
we have encountered only one explicit example of undecidability: the 
problem '<£, is total' (theorem 5-2.1). It is of considerable interest to 
identify decidable and undecidable problems; the latter, particularly, 
indicate the limitations of compu lability, and hence demonstrate the 
theoretical limits to the power of real world computers. 

In this chapter the emphasis is largely on undecidability. In ft 1 we give 
a survey of undecidable problems arising in the theory of computahiliiy 
itself, and discuss some methods for establishing undecidability. Sections 
2-5 are devoted to a sample of decidable and undecidable problems from 
other areas of mathematics: these sections will not be needed in later 
chapters and may be omitted. In the final section we discuss partial 
decidability, a notion closely related to decidability. 

Let us recall from chapter 1 that a predicate Mix) is said to be decidable 
if its characteristic function c Ml given by 



c M U) = 



1 if Mix) holds, 

if Mix) does not hold. 



is computable. This is the same as saying that Mix) is recursive (see 
chapter 3 § 2). The predicate Mix) is undecidable if it is not decidable. In 
the literature all of the following phrases are used to mean that Mix) is 
decidable. 

Mix) is recursively decidable. 
Mix) has recursive decision problem, 
M\x) is solvable. 
Mix) is recursively solvable, 
M(x) is computable. 

An algorithm for computing c M is called a decision procedure for A-/i». 









/<*)={; 



1. Undecidable problems in compu lability 

Most proofs of undecidability rest on a diagonal construction, as 
in the following important example. 

1.1. Theorem 

' x e Wx '_{or, equwaiently, '&U) ts defined', or , P,ix)i\ or 

Vui*> x) is defined') is undecidable. 
Proof. The characteristic function / of this problem is given by 

1 ifjt€W„ 

o \fxew*. 

Suppose that / is computable; we shall obtain a contradiction. 
Specifically, we make a diagonal construction of a computable function g 
such that Dom(g)# W,i=-Domi<t>,)) for every x\ this is obviously 
contradictory. 

The diagonal motto tells us lo ensure that Dom(g) differs from W, atx: 
so we aim to make 

xeDomlg) ** x£ W x . 
Lei us define %, then, by 

JO if*E W K (i.e. if/(x.) = 0}, 

*~ (undefined if xeW M (i.e.if/(x) = l). 

Since / is computable, then so is g (by Church's thesis); so we have our 
contradiction. (To sec this in detail: since g is computable take m such 
that £ = #„; then mi W„ O meDom(s) <=> m€ W„, a contradiction). 
We conclude that f is not computable, and so the problem 'x € W, ' is 
undecidable. Q 

Note thai this theorem does not say that *c cannot tell for any 
particular number a whether <p a ia) is defined. For some numbers this is 
quite simple . for instance, if we have written a program P that computes a 
total function, and P = P a , then we know immediately that $ a ia) is 
defined. What the theorem says is that there is no single general method 
for deciding whether <£,U ) is defined; i.e. there is no method that works 
for every x. 

An easy corollary to the above result is 

1 .2. Corollary 

There is a computable function h such that the problems 'x e 
Dom(A)* and 'xeR&nik)' are both undecidable. 



Proof. Let 

f* tMW. 

Undefined ifx£W,. 
Then h is computable, by Church's thesis and the en m put ability of The 
universal function t£ ): (or, formally, we have that hix)=-x l($ v (x,x)) 
which is computable by substitution). Clearly we have xeDom(A) o 
x = W M <=> x = Rani A), so the problems 'x€Dom(A}' and 'xeRan(A)' 
are undecidable, C 



Another important undecidable problem is derived easily from 
theorem 1.1: 



1.3. Theorem (the Halting problem) 

The problem '<*,(>') « defined' (or, equwaknity S P*($)¥ or y € 
W x ') is undecidable. 

Proof. Arguing informally, if the problem '«MyJ is defined' is deci- 
dable then so is the problem '4>,lx ) is defined', which is if anything easier. 
But this contradicts theorem 1.1. 

Giving this argument in full detail, let g be the characteristic function 
for '<£,(>•) is defined"; i.e. 

1 if d>Jv) is defined, 
10 if <£,(>■) is not defined. 

If g is computable, then so is the function fix) = g(x, x); but /' is the 
characteristic function of 'x g W x \ and is not computable by theorem 1.1. 
Hence g is not computable ; so '<*,[yi is defined' is undecidable. Q 



e{x.y) = 



Theorem 1.3 is often described as the Urisolvability of the Halting 
problem (for URM programs): there is no effective general method for 
discovering whether a given program running on a given input eventually 
halts. The implication of this for the theory of computer programming is 
obvious: there can be no perfectly general method for checking programs 
to see if ihey are free from possible infinite loops. 

The undecidable problem "X€ W,' of theorem 1.1 is important for 
several reasons. Among these is the fact that many problems can be 
shown to be undecidable by showing that they are at least as difficult as 
this one. We have already done this in a simple way in showing that the 
Halting problem is undecidable (theorem 1.3): this process is known as 
reducing one problem to another. 



i Unaectaaote problems in compulanuuy 
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Speaking generally, consider a problem Myx). Often we can show that 
a solution to the general problem M{x\ would lead to a solution to ihc 
•■eneral problem 'x € W,\ Then we say rhat the problem 'xeW, ' is 
reduced to the problem Mix). In other words, we can give a decision 
procedure for 'x € W/ if only we could find one for Mix\. In this case, the 
decidability of M (x) implies the decidability of 'x c W,', from which we 
conclude immediately that Mix) is undecidable. 

The s-m-n theorem is often useful in reducing 'xzW,' to other 
problems, as illustrated in the proof of the next result. 



/U\_v) = 



.4. Theorem 

The problem '«£, = 0* j* undecidable. 
Proof. Consider the function / defined by 
if x s W„ 

undefined if xtt V/,. 
We have denned f anticipating that we shall use the s-m-n theorem; 
thus we are thinking of x as a parameter, and are concerned about the 
functions g K where g x iy)=f(x, yj. We have actually designed / so that 

g x -o o xe w\. 

By Church's thesis (or by substitution using and iitu) f is computable ; 
so there is a total computable function kix) given by the s-m-n theorem 
such that fix, y)~*d>ktx}{y)', i.e. #*,,; = g„ Thus from the definition of /we 
see that 

(*) x € W, e* tp k , x) = 0. 

Hence, a particular question Is x = W, ? can be settled by answering the 
question Is # 4 . ; , : = 0? We have thus reduced the general problem 'x c W, ' 
to the general problem '£, = 0': the former is undecidable. hence so is the 
latter, as was to be proved. 

Let us present the final part of this argument in more detail as it is the 
first example of its kind. Let g be the characteristic function of '0, = 0'; 
i.e. 

I if <£,=<>. 

if <k * 0. 

Suppose that g is computable; then so is the function h(x) = g(k(x)). Bui 
from (*) above we have 

1 if fc,] = 0; i.e. x e W„ 

if<!> klxl *0;i.c.x£ W x . 



gu)=| 



h(x) = 



— '• — — 
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So by theorem 1.1 h is not computable. Hence g is not computable, and 
the problem *0, = 0' is undecidable. Q 

From theorem 1.4 we can see thai there are inherent limitations when it 
comes to checking the correctness of computer programs; this theorem 
shows that there can be no perfectly general effective method for check- 
ing whether a program will compute the zero function. By adapting the 
proof of theorem 1.4 we can see that the same is true for any particular 
computable function (see exercise 1.8(1*) below). 

The following easy corollary to theorem 1.4 shows that the question of 
whether two programs compute the same unary function is undecidable. 
Again there are obvious implications for computer programming theory. 



1.5. Corollary 

The problem '<£, = tp r ' is undecidable. 
Proof. We can easily see that this is a harder problem than the problem 

Let c be a number such that <£, = 0; if fix, y) is the characteristic 
function of the problem <b x = (£ v , then the function g{x) = f(x, c) is the 
characteristic function of '<£, = 0". By theorem 1 .4, g is not computable, 
s<» neither is f. Thus '£, ■ £ tf ' is undecidable. □ 



We use the s-m-n theorem again to reduce the problem 'x e W/ in the 
following results. 



1 .6. Theorem 

Lei c be any number. The following problems are undecidable. 

(a) (the Input or Acceptance problem) 'C€ W x ' {equivalently, 

[b) (the Output or Printing problem) 'ceE K ' {equivalently, "c£ 
Ran(<£j*). 

Proof, We are able to reduce 'x e W, ' to these problems simul- 
taneously. Consider the function fix, y) given by 

/(x v) = |> U.xmW m 

I undefined otherwise. 

(With the s-m-n theorem in mind, we axe concerned about the functions 
g t where g,(y)=- fix.y): we have designed / so that fEDom(gjo 









x*W, «■ c € Ran(gx).) By Church's thesis f is computable, and so 
the s-m-n theorem provides a total computable function k such that 
fix, y)-d>k<xtiy)- From the definition of /we see that 

iiiJ 

x£W, ^ W tlt , = E k<l) =0,soc4W kl ,,MdceE klt) . 

Thus we have reduced the problem 'x€ W x " to each of the problems 
'c € HV and -c € £/. 

Completing the proof of Id ) in detail, we see that if g is the charac- 
teristic function of 4 c s W x \ then 
„, ., (1 ifxsW,, 

This function is not computable (theorem 1.1), so g cannot be compu- 
table. Hence 'c e Wx is undecidable. 
A detailed proof of ih ) is similar. D 

We conclude this section with a very general undecidability result, from 
which theorems 1.4 and 1.6 follow immediately. It is another use of the 
•t-m-n theorem to reduce 'x€ W,\ 

1.7. Theorem (Rice's theorem) 

Suppose that &c % u and & * 0,^i. Then the problem '<p,z®' 
is undecidable. 

Proof. From the algebra of decidability (theorem 2-4.7} we know that 
'&,€&' is decidable iff '^e^fli* is decidable; so we may assume 
without any loss of generality that the function fa that is nowhere defined 
does not belong to 5? (if nou prove the result for '£-. \9S ). 

Choose a function g € 5&. Consider the function fix, y) defined by 

ft vi~i g(>) lf*eW» 

/l * w 1 undefined if x£ W x . 

The s-m-n theorem provides a total computable function k (x ) such that 
/(x,y) = ^ t [, 1 (y). Thus we see that 

xt W. => <* tu , = /esi.e. <**,*,*&. 

So we have reduced the problem ' x € W* ' to the problem '<p A e c8 ' using 
the computable function k. In the standard way we conclude that 'tp, €&* 
is undecidable. 3 
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Theorem 1.4, for example, is obtained immediately from Rice's 
theorem by taking &*-{0|, and theorem 1.6(a» by taking & = 
{* € <£| : c € Dnm(g)}. Rices theorem may be similarly applied in several 
of the exercises below. 



1.8. Exercises 

1. Show that the following problems are undecidable. 

(a) 'x e£V {Hint. Either use a direct diagonal construction, or 
reduce ~x 6 W x ' to this problem using the s-m-n theorem.). 

(b) W t = IV/ {Hint. Reduce '4> x is total* to this problem.), 

(c) 'd> x (x) = 0\ 
id) *sMy}-0*, 
ie) 'xeBy', 

'/) '^. is total and constant', 

fc) •w x = 0\ 

(A) '£, is infinite'. 

(/) '<b x = g\ where g is any fixed computable function. 

2. Show that there is no total computable function fix, y 1 with the 
following property: if P,ly\ stops, then it does so in fix, y) or 
fewer steps. (Hint. Show that if such a function exists, then the 
Halting problem is decidablc.) 



Decidability and undecidability in other areas of mathema- 
tics In many areas of mathematics there arise general problems for 
which the informal idea of decidability is meaningful. Generally such 
problems involve finite objects from a particular field of study. The idea 
of decidability of some property involving these objects can always be 
made precise using a suitable coding by natural numbers. 

Much research has been directed towards identifying both decidable 
and undecidable problems in a variety of mathematical situations: in the 
next sections we give a smalt sample of the results that have been 
obtained. 



2. The word problem for groups' 

Suppose that G is a group with identity clement 1 , and that G is 
generated by a set of elements S = {g,. g 2t g 3 }c G. A word on S is 

1 The redder with no knowledge of group theory should omit this section. 
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any expression such as g; 'gigigsg* involving the elements of 5" and the 
group operations. Each word represents an element of G. and to say that 
G is generated by S means that every element of G is represented by 
some word on S, 

The word problem for G (relative to 5) is the problem of deciding for 
which words w on S is it the case that w = 1. 

There are many groups with decidable word problem: for example any 
finite group (with S finite, of course). For many years mathematicians 
searched for an example of a finitely presented* group with Krtdecidable 
word problem. Eventually it was shown by Novikov in 1 955 and Boone in 
1957 that such groups do exist. Proofs of the Novikov-Boone Theorem 
are beyond the scope of this survey: the reader is referred to expositions 
in Rotman (19651 or Manin [1977], 

Group theory, and modern algebra in general, abounds with interes- 
ting decidable and undecidable problems; a great many of them involve 
properties of words or generators akin to the basic word problem for 
groups. 

3. Diophantine equations 

Suppose that p{x\, x z , ...,*„) is a polynomial in the variables 
Xu • • • » *«. w 'th integer coefficients. Then the equation 

p(x u x 3 , ...,*„» = 

for which integer solutions are sought is called a diophantine equation. 
Diophantine equations do not always have solutions: for instance the 
equation x -2 = 0. 

Hilbert's tenth problem, posed in 1900, asks whether there is an 
effective procedure that will determine whether any given diophantine 
equation has a solution. It was shown in 1970 by Y. Matiyasevich that 
there is no such procedure: his proof was the culmination of earlier work 
by M. Davis. J. Robinson and H. Putnam. 

Actually Matiyasevich established rather more than the unsolvability 
of Hilbcrt's tenth problem; the full Matiyasevich theorem and its appli- 
cation to Hilbert's tenth problem are discussed in §6- For complete 
details consult Davis [1973] or Manin [1977], or Bell & Machover 
[1977]. 



A group (x is finitely presented if there b a (mile seiof generators 5 and a rtniic ?ct 
B ot relations of the form w = 1 (where w it a word on S) such that ij) ail relations 
in B are true in O, and (;i> a!) other relations holding in G can be deduced from 
those in fl by using the group axioms alone. 
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4. Sturm's alKorithm 

To redress the emphasis on undecidability in the previous two 
sections, we now mention a theorem of Sturm that gives us positive results 
for computability and decidability in connection with the zeros of poly- 
nomials. 

4.1. Sturm 's th core m 

Letp(x ) be a real polynomial* and letpc. Pi p, be the sequence 

of real polynomials given by 

la) po = 0, 

ib\ Pi — p' {the derivative of p), 

lc) for 0<i<r, there is a polynomial qi such that p,-\ = p,q,-p, r i 

with p,~i 7^0 flnrfdegree(p ( _jj<degree(p ; ) [so that q : . and -pn-% 

are the quotient and remainder respectively whenp t -\ is divided bv 

P.). 

{d) p— l = p,q,. 

For any real number c denote by 5(c) the number of sign changes in the 
sequence p^.c), .... p f ic) (ignoring zeros). 

Suppose that a, b are real numbers that are not zeros of p{x), and a<b. 
Then the number of zeros ofp{x) in the interval [a, b) is &\.a)-S(b), leach 
zero being counted once only). 

This is not the place to give a proof of Sturm's theorem, which the 
reader may find clearly expounded in Cohn [1977] or Van der Waerden 
[1 949]. From our point of view, Sturm's theorem is interesting because of 
the algorithm it embodies. It gives us positive results about the compu- 
tability of the number of zeros of a polynomial, and the decidability of 
statements about zeros of polynomials. 

To frame such results, we must restrict attention to polynomials over 
ihe rational numbers, denoted by Q, so that the objects we are dealing 
with are finite. Thus we are thinking in terms of computability over the 
domain Q (which can be defined in terms of computability on ftl by the 
usual coding device}; note that a polynomial p(x) with coefficients in Q is 
essentially a sequence of rational numbers. 

A sample of the results that follow from Sturm's theorem is the 
following. 



4.2. Theorem 

(a) There is an effective procedure for calculating the number of 
real zeros of a polynomial over Q; 



tft) The predicate 'p has a zero in [a.b]' is decidable. where p 
denotes a polynomial over Q and a. b e Q. 
Proof. Given any polynomial p, the polynomials p,„ Pi. . . -,p, defined 
in Sturm's theorem may be found cfleclively by using the standard rules 
for differentiation and the division algorithm for polynomials. 

For (a), it is a routine matter to find for any polynomial p{x) a rational 
number M > such that all the zeros of p lie in the interval ]-M, M[. In 
tacLif p{x) = a + a t x + . .. + a n x". the number 

M=l Qao'--.+|fl«-iD 

a„ 

suffices. Then by Sturm's theorem the number of zeros of p is S{— A/) — 
S[M) which may be calculated effectively. 

For (b), suppose that we are given a polynomial p and rationals a, b. To 
decide whether p has a zero in [a, b], first calculate pla) and plb); if 
neither of these is zero, calculate 8{a) — 8ib) and apply Sturm's 
theorem. Q 



Of course, Sturm's theorem can be used to show that many other 
questions about polynomials over Q arc computable or decidable. 



4.3. Exercise 

Show that there is an effective procedure, given a polynomial p 
and rational numbers a, b, for finding the number of zeros of p in [a, b~\. 
(Remember that a or h may be zeros of p.) 



5. Mathematical logic 

Early investigations into the idea of effective computability were 
very much linked with the development of mathematical logic, because 
decidability was regarded as a basic question about any normalisation of 
mathematics. We shall describe some of the results that have been 
obtained in this area, in general terms that do not assume any acquain- 
tance with mathematical logic. (The reader interested to learn the basics 
of this subject may consult one of the many introductory texts, such as 
Margaris[l966].i 

The simplest logical system reflecting something of mathematical 
reasoning is the propositional calculus. In this calculus compound state- 
ments are formed from basic propositions using symbols for the logical 
connectives 'not', 'and', 'or', and 'implies'. It is quite easy, once the 



propositional calculus has been carefully defined, to see that it is <fec;- 
dable. By this we mean that there is an effective procedure for deciding 
whether a statement a of the calculus is {universally) valid; i.e. true in all 
possible situations. The method of truth tables gives an algorithm for this 
lhat will be familiar to many readers. 

A logical system that has greater expressive power than the pro- 
positional calculus is the ( first-order i predicate calculus: usine the 
language of this calculus il is possible to formalise a great deal of 
mathematics. The basic statements are formed from symbols represen- 
ting individual objects tor elements') and predicates and functions of 
them. The compound statements are formed using the logical symbols of 
the propositional calculus together with V and 3. 

There is a precise notion of a proof of a statement of the predicate 
calculus, such that a statement is provable if and only if it is valid."' In 1936 
Church showed that provability (and hence validity) in the predicate 
calculus is undecidable. unlike the simpler propositional calculus. (This 
result was regarded by Hilbert as the most fundamental undecidability 
result for the whole of mathematics.) 

We can use the URM to give an easy proof of the undecidability of 
validity, although this calls upon a certain familiarity with the predicate 
calculus. We advise the reader who does not have a rudimentary know- 
ledge of predicate logic to omil the proof That we now sketch. 

5.1. Theorem 

Validity in the first-order predicate calculus is undecidable. 
Proof. jNot advised for strangers to the predicate calculus.) 
Let P be a program in standard form having instructions /i . . . . , /, and 
let u = p [P) (as defined in chapter 2 § 2 J. We use the following symbols of 
the predicate calculus. 

a symbol tor an individual, 

a symbol for a unary function (whose value at x is x') t 
Ra symbol for a (u — U-ary relation, 
Xi, X;, . . . x„, y symbols for variable individuals. 
The interpretation we have in mind is lhat represents the number 0, ' 
represents the function x + 1. and R represents the possible states of a 
computation under P. Thus if we write 1 for 0', 2 for 0", etc. the statement 
R(r, ! ...,r u ,k) 

This is described by saying thai the notion of piovabihty is complete, and is the 
content of (jodel's romple tenets theorem. 
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where r it . . . r„. A: e fc means that the state 



. . . ; next instruction J* 



occurs in the computation. 

Now for each instruction /, we can write down a statement r. of the 
predicate calculus that describes the effect of / ; on states, using the symbol 
A for 'and' and -* for "implies': 

(a) if J) »■ Zin) let r, be the statement 

Vx t . . . Vx„: H(Xi. . . ..x„, . .. ,x„, i)-*R(X| X Ht Y). 

(b) If /, = Sin ) let r be the statement 

Vx ( . . . Vx„: R(xi, . . ..x K , . . . ,x u , i»-*RlX) x'„ t . . . ,x„, i'). 

(c) If I* = Tim, n) let r, be the statement 

Vx, . .Vx„: R(x, . x„. .. . ,x u , i)-»R(x ; x w , . . . , x K , i'J. 

(d't If /, ■= J(m, n, q) lei t, be the statement 

Vx, . .Vx u : R(Xi X»i)-*((X» = X N -*R(X|, .. .-x u ,q}) 

Now for any a €M let «t £ be the statement 

(T AT, A ... AT.ARla.O, ...,0,1J) 

-*3x l . . .Bxj Rix,,...,x u , 8 + l,i, 

where t i; is the statement VxVyiIx' = y'-*x = y>AxVO.). (This ensures 
that in any interpretation, if m. n G h and m = n then m = n.) 
The statement R;a. 0, . . . 0. 1 ) corresponds to a starling state 



a 



(I 







. . . ; next instruction I lt 



and any statement R(x. x fc , s+1) corresponds to a halting state 

(since there is no instruction A.il. Thus we shall see that 

I*) Pia)i o <r« is valid. 

Suppose first that Pia )i, and that we have a structure in which t„, . . . , t, 

and R(a, 0,1) hold. Using the statements r», . . . , t, we find that 

each of the statements R(r- r a , k) corresponding to the successive 

slates in the computation also holds. Eventually we find that a hairing 
statement R(bi, . . . , b L , s+T) holds, for some hi, . .. , b a e\, and hence 
3x, . . . 3x a R(Xi, . . -.Xu. 8 + 1) holds. Thus tr* is valid. 



Conversely, if <r„ is valid, ii holds in particular in the structure N with 
the predicate symbol R interpreted by the predicate R a where 

R ei a . £«,/:) = At some stage in the computation Pia) the 

registers contain a l ,a 2 ,...,a t ,,Q.O,... and 
the next instruction is /*. 

Then t , . . . , t, and R(a, 0, .... 0, 1) all hold in this structure, hence so 

does 3x, . .. 3x u R(Xn x„sf 1). Therefore P(a)i. 

If we lake P to be a program that computes the function tp^ix.x), the 
equivalence (*) gives a reduction of the problem '* = W K ~ to the problem 
'a- is valid'. Hence the latter is undccidable. ~3 



The field of mathematical logic abounds with decidability and undcci- 
dability results. A common type of problem that arises is whether a 
statement is true in all mathematical structures of a certain kind. It has 
been shown, for example, that the problem 

'a is a statement that is true in all groups' 

is undecidable (here a is a statement of the first-order predicate language 
appropriate to groups), whereas the problem 

'a- is a statement that is true in all abelian groups* 

is decidablc. iWe say that the first-order theory of groups is undecidable 
whereas the first-order theory of abelian groups is decidable.) It was 
shown by Tarski 1 195 1 ] that the problem 

'<r is true in the field of real numbers* 

is decidable. On the other hand, many problems connected with the 
formaiisation of ordinary arithmetic on the natural numbers are 
undecidable, as we shall see m chapter 8. 

For further examples and proofs of decidability and undecidability 
results in logic the reader should consult hooks such as Tarski, Mostowski 
& Robinson [1953], or Boolos & Jeffrey 11974 J. 

6. Partially decidable predicates 

Although the predicate 'xeW,' has non-computable charac- 
teristic function, the following function connected with this problem ts 
computable: 

(I ifxeW x . 

I undefined if .t £ W,. 

If we continue to think of 1 as a code for Yes, then any algorithm for ,' is a 
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procedure that gives answer Yes when x € W„ but goes on for ever when 
x eV/, does not hold. Such a procedure is called a partial decision 
procedure for the problem 'xe W/, and we say that this problem or 
predicate is partially decidable. 

Many undecidable predicates turn out to be partially decidable : let us 
formulate the general definition. 



6.1. Definition 

A predicate Mix) of natural numbers is partially decidable if the 
function / given by 

1 if A/(x) holds. 



/(*)- 



undefined if M(x) does not hold, 



is computable. (This function is called the partial characteristic function 

for j M.) If M is partially decidable. any algorithm for computing/ is called 

a partial decision procedure for M. 

Note, In the literature the terms partially solvable, semi-computable, and 

recursively enumerable are used with the same meaning as partially 

decidable. 

6.2. Examples 

1. The Halting problem (theorem 1.3) is partially decidable, since 
its partial characteristic function 

fix t= [1 ifP *<yU. 

I undefined otherwise, 
is computable, by Church's thesis (or by observing that fix, y) — 

i(*uU y)))- 

2. Any decidable predicate is partially decidable: simply arrange 
for the decision procedure to enter a loop whenever it gives 
output 0. 

3. For any computable function g[x) the problem 'x s Dom(g)' is 
partially decidable, since it has the computable partial charac- 
teristic function l(g(x)). (Cf. corollary 1.2.) 

4. The problem 'x£ W x ' is not partially decidable: for if / is its 
partial characteristic function, then 

x€Dom{f)&xeW„ 

Thus Dom l.7*i differs from the domain of every unary computable 
function: hence / is not computable. 

1 The reason for ihe use of Urn terra W:l! be explained in the i>cxi chapter. 
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We proceed to establish some of the important characteristics of 
partially decidable predicates. First we have the alternative charac- 
terisation that is given essentially in example 6.2(3) above. 

6.3. Theorem 

A predicate Mix) is partially decidable if and only if there is a 
computable function gtx) such that 

Mi_x) iff xsDomig). 

Proof If M{x) is partially decidable with computable partial charac- 
teristic function fix), then from the definition we have M(x) iff 
x s Dom(/>. The converse is given by example 6.2(3) above. D 

The following characterisation of partially decidable predicates shows 
how they arc related to decidable predicates. 

6.4. Theorem 

A predicate M{x) is partially decidable if and only if there is a 
dectdable predicate R(x, y) such thai 

Mix) iff 3yR{x*y), 
Proof Suppose that Rtx, y) is a decidable predicate and that Myx) iff 
3y«(*, y). By corollary 2-5.3 the function gix)~ p.\Rix, y) is compu- 
table; clearly 

M(x) ** xeDom{g), 

so M (*) is partially decidable by theorem 6.3. 

For the converse, suppose that M[x) is partially decidable, with partial 
decision procedure given by a program P. Define a predicate R{x, y) by 

R(x, y) m P(x)i in y steps. 
By corollary 5-1.3, R(x, y) is decidable. Moreover, 
M(x) O P{x)i 

O 3yfZ(*y) 
as required. D 

Note. From the appendix to chapter 5 it follows that the predicate R in 
this characterisation may be taken lo be primitive recursive (see the 
note I following corollary 5-1.4). 

The characterisation given by theorem 6.4 indicates an important way 
to think of partially decidable predicates. It shows that partial decision 
procedures can always be cast in the form of an unbounded search for a 
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number y having some decidable property R(x, y). This search is most 
naturally carried out by examining successively > ' — 0, 1, 2, . . . to find 
such a y. The search halts if and when > is found such that R(x, y) holds; 
otherwise the search goes on for ever. 

We can use theorem 6.4 to establish some further properties of 
partially decidable predicates, that aid us in their recognition. 

6.5. Theorem 

If M[x, y) is partially decidable, then so is the predicate 
3yMlx. y). 

Proof. Take a decidable predicate Rix, y, z) such that M (x, y) iff 
BzR(x, y, z). Then we have 

3y.Uli, y) O By3zR[x,y,z). 

We can use the standard technique of coding the pair of numbers y, z by 
the single number u = 2'3 : ; then the search for a pair y. r such that 
Rix.y.z) reduces to the search for a single number u such that 
Rix, (k)i, (w.lj), i.e. 

3yM(x,y) O 3uR{x,{u) u {uhl 

The predicate S(x t u) m R{x, (k)i, (11)2) is decidable (by substitution) and 
so by theorem 6.4 3yAf (x, y) is partially decidable. D 

Theorem 6.5 is described by saying that partially decidable predicates 
are closed under existential quantification. Its repeated application gives 

6.6. Corollary 

If Mix, y) is partially decidable, where y = (yi. - . . , y*), then so is 
the predicate 3yj .. , 3y m Mix, >'i, .. .,y m ). 

Let us ::c.v consider sum; ;ippi:calinns of the anovc results. 



6.7. Examples 

1. The following predicates are partially decidable. 

ia) x £ E'"' {n fixed). (The Printing problem: cf. theorem 1 .6.) 
{b) W t *0 (Cf. exercise 1.8(1*).) 

Proofs 
(a) xeE ( ? «> 32 1 ...32 n 3/(/ > l (?,,....? ll )irin/steps).The 
predicate in the brackets on the right is decidable; apply coro- 
llary 6.6. 

lb) W x * O 3y3r(P.(y)i in / steps); again the predicate in 
brackets is decidable, so corollary 6.6 applies. 
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2. Provability in the predicate calculus is partially decidable (this is 
for those who have read § 5). 

Proof. We proceed informally; in the predicate calculus a 
proof is defined as a finite object (usually a sequence of state- 
ments) in such a way that the predicate 

Pr(d, or) = 'd is a proof of the statement tr' 

is decidable. Then we have 

<x is provable O 3d Pud, tr), 

hence V is provable' is partially decidable. 

6.8. Diophantine predicates (cf. § 3) 

Suppose that pUi x m yi y„) is a polynomial with 

integer coefficients. Then the predicate Mix) given by 

M U> = 3y, . . . 3y m (p(x, y,, . . . , y m ) = 0) 

is called a diophantine predicate, because of us obvious connection with 
diophantine equations. (The quantifiers 3yj, . . . , By m are taken as 
ranging over M.) 

Example The predicate k x is a perfect square' is diophantine, 
since it is equivalent to 3y(x — y = 0). 

From corollary 6.6 we have immediately 

6.9. Theorem 

Diophantine predicates are partially decidable. 
Proof. The predicate p(x, >•) = is decidable; apply corollary 6.6. □ 

Clearly, diophantine predicates are partially decidable predicates that 
can be cast in a relatively simple form, and for a long time it was not 
known whether any undecidablc diophantine predicates existed. This 
question is closely connected with Hilbert's tenth problem (§ 31, as we 
shall see. It was a most remarkable achievement, therefore, when Mati- 
yascvich proved in 1970: 



6.10. Theorem 

Every partially decidabie predicate is diophantine. 

The proof of this result by Maliyascvich rested heavily on earlier work 
of Davis, Robinson and Putnam, and is far too long to present here. Full 
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proofs are given in Davis £1973], Bell & Machover [1977] and Manin 
r 1977]. The major part of the proof consists in showing that diophantine 
predicates are closed under bounded universal quantification: i.e. if 
Mix. y) is diophantine then so is the predicate Vs<yW(x, z). (It is an 
easy exercise to show that partially decidable predicates are closed under 
bounded universal quantification; see exercise 6.14(5) below.) 

We can see how a negative solution to Hilbert's tenth problem is easily 
derived from Matiyasevich's theorem. First note that if the problem 
posed by Hilbert is decidable. then so is the problem of deciding for a 
general polynomial equation p[x lt . . - , x„) = (with integer coefficients) 
whether it has a solution in the natural numbers: this is because any 
natural number is expressible as the sum of four squares, so we simply 
look for integer solutions to 

pUi + ri + wi-fi sl + tl+ul + vl) = G. 

Now take a polynomial plx, yi y«) such that 

x e W t t> 3y, . . . 3y m {p(x, y,, . . . , y m ) = 0) 

Uhis is possible by Matiyasevich's theorem). Then a decision procedure 
for Hilbert's problem would give the following decision procedure for 
'xsW,': to test whether a e VV'„ see whether the polynomial 
trly:.- • - - Vm) = p(^ >'i- •• ■ 7 >'•») has a solution in , y. So 'x € W,' has been 
reduced to Hilbert's problem: hence ihe latter is undecidablc 

We shall mention another (surprising) consequence of Matiyasevich's 
theorem in the next chapter. 

We conclude this chapter with two important results, linking partially 
decidable predicates with decidable predicates (theorem 6.11) and 
computable functions (theorem 6.13). 

6.11. Theorem 

A predicate Mix) i$ decidable if and only if both Mix) and 'not 
A/ {x)' are partially decidable. 

Proof. If Af (*) is decidable, so is 'not Af (x)', so both are partially 
decidable. 

Conversely, suppose that partial decision procedures for Mix) and 'not 
Mix)' are given by programs F, G. Then 



F(x)l O M(x) holds 



and 



C(x)i «• 'not M {x}' holds. 

Moreover, for any x, either FixK °r G(x)i but not both. Thus 
the following is an algorithm for deciding Mix). Given x, run the 



computations Fix ) and G(x) simultaneously (or carry ou! alternately one 
step in each computation), and go on until one of them stops If it is F(*J 
Chat stops, .hen conclude .hat M{x) holds: if it is G(x) that stops, then 
Mix) does no. hold. D 

This theorem gives an alternative proof that the predicate -x£ Wf is 
not partially decidable. Similarly we have 

6.12. Corollary 

^ The predicate -PAy)V (the Divergence problem: equivalently, 
'y * W, \ or $, (y ) is undefined') is no: partially decidable. 

Proof. If this problem were partially decidable, .hen by theorem 6.11 
and example 6.2(1) the Halting problem P, [y)j would be decidable. □ 

The final result of this chapter gives a useful way lo show that a func.ion 
is computable. 



6.13. Theorem 

Let fix) he a partial function. Then f is computable ifandonlv if 
(he predicate 

fW-y' 

is partially decidable. 

Proof. If / is computable by a program P, .hen we have 

fix)~y o a.'tPOrUy in /steps). 

The predicate on the right is parlially decidable bv theorem 6.4 and 
corollary 5-1.3. 

Conversely, suppose thai the predicate >f{x) - y' is partially decidable. 
Let R (x, y. i) be a decidable predicate such that /(*) =■ y ■» 3tR { x , y, rt. 
Then we have the following algorithm for computing fix). 

Search for a pair of numbers y. r such that Rix. y. t) holds: if and when 
such a pair is found, then/lx) = y. 

Hence / is computable. [A formal proof of the computability of f could 
be given by (he standard technique of coding a pair v. t bv the single 
number z = 2 y 3'. See exercise 6.14(8) below.) D 

Further properties of partially decidable predicates are given in the 
exercises below (see in particular exercises 6.14(4, 5, 9)j. 

In .he nex. chapter we will be studying unary partiallv decidable 
predicates in greater detail, in the guise of recursively enumerable sets. We 
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shall see in particular why parlially decidable predicates are often 
described as recursively enumerable predicates. 

6.14. t-xercises 

1. Show that the following predicates are partially decidable: 

(a) -Er*0" infixed). 

ib) '<£.ly) is a perfect square", 

[c] 'n is a Ferma. number'. (We say that n is a Fermat number if 

there are numbers x, y, 2>0such that**+y" = z"A 

id) There is a run of exactly x consecutive 7s in the decimal 

expansion of it'. 

2. tFor those knowing some group theory! Show that the word 
problem for any finitely presented group is partially decidable, 

3. A finite set S of 3 x 3 matrices is said to be mortal if there is a 
finite product of members of S thai equals the zero matrix. Show 
.hat the predicate '5 is mortal' is partially decidable. {It has been 
shown that this problem is not decidable: see Paterson [19701.) 

4. Suppose that M{x) and .Vix.i are partially decidable: prove that 
.he predicates 'Mix) and N[x)\ 'M(x) or >V{xY are partially 
decidable. Show that the predicate "not Mix)* is not necessarily 
partially decidable. 

5. Suppose thai Mix, y ) is partially decidable, Show that 
{a) '3y<zMtx. yY is partially decidable, 

(b) *Vy<j M{x, yY is partially decidable. 

{Hint. If f\x,y) is the partial characteristic function of M. 

consider the function [T.<*/(*« >')•) 

(e) 'VyM{x, yY is not necessarily partially decidable. 

6. Show that the following predicates are diophantine. 
(a* 'x is even', 

(b) 'x divides y'. 

7. (This exercise shows how the technique of reducibility (§ 1 ) may 
be used to show that a predicate is not partially decidable.) 

(a) Suppose that Mix) is a predicate and k a total computable 
function such that x € W x iff M(Jc(x)) does not hold. Prove (hat 
Mix) is not partially decidable. 

i.b) Prove that 'e\ is not total' is not partially decidable. 
(Hint. Consider the function k in the proof of theorem 1 .6.) 

(c) By considering the function 

{1 ifP t (x) does not converge in y or 

fewer steps, 
undefined otherwise, 
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show that '<& is total" is not partially decidable. [Hint. Use the 
s-W-fl Iheorem and (o).) 

8. Give a formal proof of The second half of Theorem 6.13; Le. if 
-f{xt = y' is partially decidable, then / is computable. 

9. Suppose that M[ Xl x,)h partially decidable and g, & 

are computable partial functions. Show thai the predicate N(f ) 
given by 

N{y)mM{ Sl (y), . . . , g n (y)) 

is partially decidable. (We take this lo mean that N{y) does not 
hold if any one of g^ly), .... g„(y) is undefined.) 



Recursive and recursively 
enumerable sets 



The sets mentioned in the title to this chapter are subsets of \1 cor- 
responding to decidable and partially decidable predicates. We discuss 
recursive sets briefly in 5 1. The major part of this chapter is devoted to 
the study of recursively enumerable sets, beginning in § 2; many of the 
basic properties of these sets are derived directly from the results about 
partially decidable. predicates in the previous chapter. The central new 
result in §2 is the characterisation of recursively enumerable sets thai 
gives them their name: they are sets that can be enumerated by a 
recursive (or computable! function. 

In H 3 and 4 we introduce creative sets and simple sets: these are 
special kinds of recursively enumerable sets that are in marked contrast to 
each other; they give a him of the great variety existing within this class of 
sets. 



1. Recursive sets 

There is a close connection between unary predicates of natural 
numbers and subsets of N: corresponding to any predicate Mix > we have 
the set{x : Mix) holds}, called the extent of M (which could, of course, be 
S3); while to a set Mr'-sj there corresponds the predicate 'x €A\ The 
name recursive is given to sets corresponding in this way to predicates that 
are decidabie. 



1.1. Definition 

Let A be a subset of N. The characteristic function of A is the 
function ca given by 

1 MxeA, 
itx&A. 



c A ix) = 



1 As mentioned in 3 footnote to § 3 of the Prologue, predicates B.-C alien identified 
with their extent: thai view would nor be iiieoitsisteru with our «posit:on. 



Then A is said to be recursive if c A is computable, or equivalent^, if 

'x € A ' is a decidable predicate. 

Notes 

1. For obvious reasons, recursive sets are also called computable sets. 

2. IF c A is primitive recursive, the set A is said to be primitive recursive. 

3. The idea of a recursive set can be extended in the obvious way to 
subsets of h"\n > 1 ), although in the text we shall {as is common practice) 
restrict the use of the term to subsets of M There is no loss of generality in 
doing this, because recursive subsets of 1ST can easily be coded as 
recursive subsets of V See exercise 1.4(2) below for details. 

1.2. Examples 

1. The following sets are recursive. 

it*) E (the even numbers), 

(c) any finite set, 

id I the set of prime numbers. 

2. The following sets are not recursive. 
(a) {x : & is total) (theorem 5-2. 1 ), 
(A) \x: xe W x \ (theorem 6-1 . 1 ). 
(c) {*:*,-0} (theorem 6-1.4). 

The algebra of decidability (corollary 2-4.71 gives us the following 
properties of recursive sets immediately. 

1.3. Theorem 

If A, B are recursive sets, then \o are the sets A,Ar,B.A~B 
A\B. 

Proof. Direct translation of corollary 2-4.7. 3 
Further facts about recursive sets will emerge in § 2. 

1.4. Exercises 

1 . Let A, B be subsets of H. Define sets A QB and A <BB by 

A®B = {2x:x€A)^{2x + l:xeB\ 

A(&B = [nix, y) :x e A and y e B), 

where tt is the pairing function ir{x, y) = 2 x (2y + I)-l of 
■-hcurem -- " .2. Prove thai 

(a) AOB is recursive iff A and B are both recursive, 

(b) IfA,B* 0, then A®B is recursive iff A and B are both 
recursive. 
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2. \a ) LetB eft and leln > 1: prove that if B is recursive then ihe 
predicate Mix,, . ... , X,) given by 
Jv/(x 1 ,...,x,) = 2 x -3' ; ...p^eB 

is decidable. 

\b) Let A = iV: define A to be recursive if the predicate 
'xeA' is decidable. Prove that A is recursive iff 
{2 s 3* a . . . p>: (Xi t ■ - . ,x„J g A] fe recursive. 

2. Recursively enumerable sets 

We turn now to the subsets of fa that correspond to partially 
decidable predicates. These constitute an important class, if only because 
of the many situations in which they occur. 

2.1. Definition 

Let A be a subset of fa. Then A is recursively enumerable if the 
function f given by 

_jl ifie.4, 

/( * } ~ I undefined ifxtf.4 

is computable (or, equivalently. if the predicate 'xeA' is partially 
decidable). The phrase recursively enumerable is almost universally 
abbreviated r.c. 
Notes 

1. The terms semi-recursive sets and semi-computable sets are also used 
to describe r.e. sets; indeed, from the above definition these names would 
appear more appropriate than recursively enumerable. We will, neverthe- 
less, adhere to the standard name recursively enumerable, which stems 
from the fact that these sets may also be defined as sets that can be 
enumerated by a recursive lor computable) function. This alternative 
characterisation is given in theorem 2.7 below. 

2. As with recursive sets, the idea of r.e. sets can be extended in the 
obvious way to subsets of fa" (n > 1 ), but there is no loss of generality in 
confining attention (as we do in the text) to r.e. subsets of N. See exercise 
2.18(9) below. 



2.2. Examples 

1. Let K = {x:x£ IV,}; then K is an r.e. set that is not recursive. 
(example 6-6.2(1)). Its complement K is not r.e. (example 
6-6.2(4)). 

2. Anv recursive set is r.e. {example 6-6.2(2)). 
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3. The set {*: IV, ^ 0} j s r . e . ..example 6-6.7<l(^)». 

4. li f is a computable function, then Rani/) is r.e. {example 
6-6.7(lflI: cf. theorem 2.7 below). 

Note. K is the standard notation for the set {*; xc W,} (example 
1 above), which plays a prominent role in the study of r.e. sets. 

Most of the results for partially decidable predicates in chapter 
6 § 6 translate immediately into the language of r.e. sets. We 
begin with 

2.3. Theorem 

A set is r.e. if and only if it is the domain of a unary computable 
function. 
Proof. Theorem 6-6.3. D 

We conclude from this theorem thai the enumeration 

is an enumeration (with repetitions) of all r.e. sets. If A = W e , then e is 
called an index for A. 

From theorem 6-6.4 we obtain the next characterisation of r.e. sets. 



2.4. Theorem 

The set A is r.e. tf and only if there is a decidable predicate R ix, y) 
such that 

xeA iff ByR(x,y). 

(From the note following the proof of theorem 6-6.4 this predicate R may 
be taken to be primitive recursive.) 

We also have the following immediately from theorem 6-6.5. 

2.5. Theorem 

Suppose that Mix, y ,, . . .,y n ) is partially decidable; then the set 
{v:3yi . . . 3yjtf(x. y, f y„)} is r.e. 

The following link between r.e. sets and recursive sets is an immediate 
application of theorem 6-6.11. 

2.6. Theorem 

The set A is recursive if and only if A and A are r.e. 
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Proof This is immediate from theorem 6-6.11. but it is instructive to 
give a formal proof of the non-trivial half of the proof. Suppose then that 
R and 5 are decidable predicates such that 

xsA <=> 3y«U, y) 

ieA« 3yS(x, y ) 
(we are using theorem 2.4). Now define a function f{x ) by 

f(x) = pyXRfo yl or Six, >•)). 
By the results of chapter 2, / is computable; further, since for every x, 
either x e A or x = A. f{x) is always defined, and we have 

Thus 'xeA' is decidable. so A is recursive. D 

We now turn to the characterisation of r.e. sets that gives them their 
name. 



2.7. Theorem 

Let /4c"-j. Then the following are equivalent: 
[a ) A is r.e., 

[b I .4 = or A is the range of a unary total computable function, 
[c) A is the range of a partial I computable function. 
Proof. We shall prove the chain of implications (at ^> ib) =£> ic) ^ 

(4). 

Ka)^ib) Suppose that A*0 and that A-Dom(/), where f is 
computed by a program P. Choose an element a e A. Then A is the range 
of the following total binary function: 

x if P{x)i in r steps, 
.a otherwise. 

Clearly g is computable. To complete the proof we construct a unary total 
computable function h having the same range as g. Let 

Clearly Ran(A ) = Ran(g) = A. 

ib) :> (c) is trivial. 

(c) ^ (d) Suppose that .4 = Ran('i) where h is an /i-ary computable 

function. Then 

xeA » 3y l ...3y„lA{y„...,yJ=.v). 

The predicate in brackets on the right is partially decidable (theorem 
6-6.13) so applying theorem 2.5 we see that A is r.e. D 
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{The reader may have noticed that various parts of this theorem have 
been given, more or less explicitly, in examples and exercises earlier in 
this and other chapters.) 

Notice thai il is from theorem 2.7(A) particularly that the name 
recursively enumerable comes: a non-empty r.e. sel is a set that ean be 
enumerated a$A = {n\Q), A(l), /i(2), . .. } where h '^ix recursive li.e. total 
computable) function. In fact, by using the results of chapter 5 (and 
appendix) it is easily seen that the enumerating function h in the proof of 
(a) => ib) is primitive recursive- 
Note also that theorem 2.7 tells us that the enumeration E,,, E u E z , . . . 
of the ranges of unary computable functions is another enumeration (with 
repetitions) of all r.e. sets. In informal terms, theorem 2.7 shows that r.e. 
sets are the same as effectively generated sets. We would call a sel A 
effectively generated if there is an informal effective procedure for 
compiling a list of the members of A, Such a procedure would from time 
to time inot necessarily at regular intervals) output a number to be added 
to the list. The procedure may go on ad infinitum (and certainly must if A 
is infinite). To see that a set A generated in this way is r.e.. simply put 
/(0) = 1st number listed by the procedure. 



fin) — in * l)th number listed by the procedure. 

where fin ) is defined iff there is an in + 1 >th number listed. Then clearly/ 
is computable, and A = Rant/) is r.e. 
We can illustrate this with an example. 

2.8. Example 

The set {x: there is a run Of exactly x consecutive 7s in the 
decimal expansion of w} is r.e. (cf. exercise 6-6. I4(lrf». The following is 
an informal procedure that generates this set of numbers. 'Run an 
algorithm that computes successive digits in the decimal expansion of it. 
Each time a run of 7s appears, count the number of consecutive 7s in the 
run and add this number to the list.* 

The characterisation of theorem 2.7 gives us a straightforward diagonal 
proof that total computable functions cannot be recursively enumerated. 



2.9. Theorem 

The set {x : <*>, is total) is not r.e. 
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Proof. (Cf. the suggested proof of this result given in exercise 6- 
6.14{7c).) 

Suppose to the contrary that f is a total unary compu- 
table function that enumerate* this set; i.e. d>fty>. 4>io>> 0/O>i - - - ' s a hSt °* 
all unary computable functions. Then we can easily make a diagonal 
construction of a total computable function g that differs from every 
function in this list. The diagonal motto says 'make g differ from tJr f<K , at 
n\ so we put 

Then (• is computable and total, but g ■**/,«,, for every m. This is a 
contradiction. Z! 

There is one important result about partially decidable predicates that 
we have so far omitted to transfer to the setting of r.e. sets, namely the 
connection with diophantine predicates. First we make a definition. 

2.11). Definition 

A set A<^h is diophantine if there is a polynomial 
pix, y-_, . . . , y„! with integer coefficients such that 

xeA iff 3y, . . . 3yAp(x, y,, . . . , y„) = U). 

Of course, diophantine sets are r.e., and Matiyasevich's theorem 
(6-6.101 may be expressed (as it often is) as: 



2.11. Theorem i.Matiyascvich) 

AH r.e. sets are diophantine. 

This is an appropriate place to mention a surprising (but easy) 
consequence of Matiyasevich's theorem. 

.1.12. Theorem 

A set is r.e. if and only if if is the set of non-negative values 
taken by some polynomial p{xu . . . . x n ) with integer coefficients (for values 
ofx\,...,x n from MJ. 

Proof. Suppose that .4 is the set of non-negative values taken by 
p(*i, ..-,.<„): then x£At$3x : ...'Bx n (p{x J ,...,x K ) = x), so A is 
clearly r.e. 

Conversely, if A is r.e. then by Matiyasevich's theorem there is a 
polynomial qix, y\ y m \ such that 

xeA O 3ft...3]' H taftrj>i J»*)=0). 



Then consider the polynomial pix. y) given by 

plx,Y) = x~(x^lHq(x t y))\ 
pix, y) is non-negative if, and only if. q( x , y ) = 0. and then it takes ihe 
value x. Thus A is the set of non-negative values taken by p(x, v) as 
x> Jfu - - - , y„, run through f-4. 

(The restriction of x u . . x* to M in the statement of this theorem is 
somewhat arbitrary; it is an easy exercise to see that the theorem is valid 
when xi, . . ,, x„ arc allowed to range over 2.1 

One application of this result that has aroused considerable interest 
among mathematicians is to Ihc set of prime numbers: this set, being r.e., 
is the set of positive values taken by a polynomial with integer 
coefficients, a result thought to be most unlikely before Matiyasevich 
came on the scene. 

A refinement of theorem 2.12 shows that there is a single universal 
polynomial, which generates all r.e. sets: i.e. a polynomial 

P {z - *' >*' Vm) *ith the property that for any r.e. set A there is a 

number z such that 

x€A o Byi...By M {p(?,x t yi >„) = 0). 

To see this, simply note that the Halting problem 'x € W t ' is diophantine 

and take z to be an index for .4. 

At this stage we should summarise the various characterisations of r.e. 
sets that we now have available. The following are all equivalent condi- 
lions on a set A of natural numbers: 

(1) x e A' is partially decidable (we have taken this as our basic 
definition). 

(2) A is the domain of a unary computable function; i.e. A = W r 
for some e (theorem 2.3), 

(3) For some decidable predicate R(x, y). x e A ** By Rix, y) 

(theorem 2.4), 

(4} For some partially decidable predicate Mix. y y, ), 

x € A » 3y, . . . 3y„A/U y, , y n ) (theorem 2.5), 

(5( If A # 0, A is the range of a total unary computable Function 
(theorem 2.7), 

(6) A is the range of a computable function (theorem 2.7). 
!7] A is diophantine (theorem 2.11), 

(8) A is the set of non-negative values taken by a polynomial 
with integer coefficients (theorem 2.12). 



Naturally, when working with r.e. sets one chooses the characterisation 
that is most convenient for the purpose in hand. Wc illustrate this in the 
proof of the next theorem. 

2.13. Theorem 

If A and B are r.e., then so are A*B and A^B. 

Proof. For A r>B use characterisation (2>. Suppose that A = Dom(/) 
and B - Doratg) with f. g computable. Then A n B = Dom{/g), and fg 
is computable. 

For AvW use characterisation (5). If A = or B = 3 there is nothing 
to prove. So suppose that A = RanI/l andB = Ran(gt where/, g are total 
computable. Define h ">y 

h{2x)~f\x). 

h[2x-U = g(x). 

Then h is computable and clearly Ran(fc) = A<jB. D 

(It is instructive to find proofs for this theorem using each of the other 
characterisations of r.e. sets.) 

Our next theorem gives another link between r.e. sets and recursive 
sets. 



2.14. Theorem 

An infinite set is recursive if and only if il is the range of a total 
increasing computable function, i.e. if it can be recursively enumerated in 
increasing order. 

Proof. Suppose that A is recursive and infinite; then A is enumerated 
by the increasing function / given hy 

fiO) = t iyiyeA). 

fin + l) = ju>(>'C -A and >•>/(« l). 

Moreover. / is computable by minima I isation, recursion and the recur- 
siveness of A. 

Conversely, suppose that .4 is the range of the computable total 
increasing function /; i.e. /(0) </(!)< /(2)< ... It is clear that if y =f{n) 
then n s y. Hence we have 

ye A Oye Rani/") 

-» 3rtSy(/(n>- y) 

and the predicate on the right is decidable. Hence A is recursive. □ 



(An alternative proof could be given by showing that A is r.e.; we leave 
this as an exercise for the reader, i 



The above theorem may be applied to prove 



2.15. Theorem 

Every infinite r.e. set has an infinite recursive subset. 
Proof. Let A = Rani/) where / is a total computable function. We can 
effectively enumerate a subset of A in increasing order by a function g as 
follows 

g(0) = /<0>, 

g(n - 1 ) = f(x ), where x = fiy (/(>•) > g(n J). 

Since A = Ran{/) is infinite, g is totally defined. By construction, 
Ran(s) c Ran(/) and g is increasing. It is clear that g is computable, by 
minirnalisation and recursion. Hence by theorem 2.14. Ran(g) is an 
infinite recursive subset of A. D 

We conclude this section with a theorem of Rice and Shapiro about r.e. 
sets of indices. We shall need this result in chapter 10, and there are other 
applications we can make immediately, but it is of significance in its own 
right. The theorem and its proof are generalisations of Rice's theorem 
(6-1 .7). (In the statement of this theorem, by a finite function we mean a 
function whose domain is finite: note that all finite functions are 

computable.) 

■ 

2.16. Tlieorem (Rice-Shapiro) 

Suppose that si is a set of unary computable functions suck that the 
sel fe^jj ■**} " r - e - Tte" f or a*} unary computable function f, 

fed iff there is a fin ite fun ction 9sf with its si. 

Before wc prove this result, let us illustrate how it can be used to give 
quick proofs of non-recursive enumcrability. (Further applications of this 
kind are given in exercises 2.18 below.) 

2.17. Corollary 

The sets {x : <fr, is totai) and {x : A x U not total) are not r.e. 
Proof. For A = (x : <f> x is total) wc apply the Rice-Shapiro theorem to 
the set s4 = {f\fz % t and/is total}. Far no fed is there a finite ffs/ with 
B e A. Hence A is not r.e. 



-a ntcHracm itutmrrap:? .lis 



Ul 



For B = {x:t£ x is not total}, consider the set 3 = {/:/e tfi and /"is not 
total}. Then if / is any total computable function, f£ 3i ; but every finite 
function 0sf is in $. So B cannot be r.e., by the Rice-Shapiro 
theorem. D 

[Note. This is the third proof we have of the non-recursive enumerability 
of the indices of total functions: others are exercise 6-6.14(7c) and 
theorem 2.9 above. The reader will see that the proof suggested in the 
first of these is actually the specialisation of the following proof.) 
We return to the proof of the Rice-Shapiro theorem. 
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Proof of theorem 2.16 

Lot A ={x:4i i i rf}„ We are given that A is r.e. We shall show 
that if either implication in the statement of the theorem is false, then the 
problem 'x €K' can be reduced to 'x €A\ {Recall from example 2.2(1) 
that K = {x:x€ W x }.) This would show that K is r.e., a contradiction. 

Suppose first that/e si but $t .<4 for all finite Q f. Let P be a program 
such that P(z)i £ z zK, Define a computable function g'.z, t) by 

jf{t) if P\z)l in /or fewer steps. 

• undefined if P\z){ in t or fewer steps. 

The a-m-n theorem provides a total computable function slz I such thai 
g(z, t)^it> t ,ii). Note that by construction tfrtitt^f f° r a " *■ ^ ve claim 
further that 

, jzeK ^ #, ; , ; is finite (hence 6, l:i f d), 

\z*K =} <k lr . = / (hence & : , .ejrf). 
For if z <: K, there is t such that P{z )[ in r steps. Then g{z, /'» — <£ m i(r') is 
undefined for rsr. Hence &, u , is finite. On the other hand, ii z£K, then 
giz, t) =/(/) for all /, so <6 U: _, = f. 

Now (*) means that .-cKO s{z)eA, which implies that K is r.e.. a 
contradiction. Hence there must be a finite $ q f with tf = A. 

For the reverse implication, suppose that f is a computable function, 
such that there is a finite function ft €.4 with 0Qf, but ft si. Define a 
computable function g(z, t) by 

(fit) if t e Dom{0) or z c K, 

lundefined otherwise. 
The s-m-n theorem provides a total computable ${z) such that g(z, t) — 
tfrsii'A')- From the definition of g and the fact that 6sf we see that 
zeK ^ &; ( ; = /(hence<£ Jti ,g.s*» 
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and 

z£K ^ &„ II =f\Dom{6) = 6 (hence <*,«,, ejtf). 

Bui this means that z *K <=> jl*)e A, again showing that iC is r.e., a 
contradiction. Thus fest as required. D 

We leave it as an exereise for the reader to see how the Rice-Shapiro 
theorem generalises Rice's theorem (exercise 2.18(12) below). 



2.18. Exercises 

1. ForanyaeN, lct fl W, = {x:^U) = a}. Show that c W r isr.e. (all 
a). Does the enumeration "W^, ""W-'i, "W;, . . . include all r.e. 
sets 9 

2. Show that the set {x : d> t is not injeetive} is r.e. 

3. Show that there are total computable functions k, ! such thai for 
every x, W x = E kl „ and E x = IV fi ,> 

4. Suppose that A is an r.e. set. Show that the sets .J.** W k and 
U.>e.4 Ex are both r.e. 

Show that n. = a W"' x is not necessarily r.e. as follows. For any r 
let K, = {x: P,i»i in f steps}. Show that for any /, K. is recursive; 
moreover K - (J„ ^ K : and K = (~\ M K,. 

5. Let /he a unary computable function, and suppose that -4 c 
Dom(/), andletg = /|A. Prove that£ is computable iff A is r.e. 

6. Let/ be a unary function. Prove that f is computable iff the set 
{2'"3'* l,i, :.(sDomt/)}isr.e. 

7. (Cf. theorem 2.14.1 Let A bean infinite r.e. set. Show that A can 
be enumerated without repetitions by a total computable 
function. 

8. Which of the following sets are recursive? Which arc r.e.? Which 
have r.e. complement? 

Ifl) {x:xeE s }, 

\b) {x:x is a perfect square}, 

(c) {x:<£ s is injeetive}, 

id.) {.r: there is a run of or least x consecutive 7s in the decimal 

expansion of n], 

£e) {x:P„(x)\} {m is fixed). 

9. (Cf. Exercise 1.4(2). J [a) Let B £W and let n > 1; prove that if H 
is r.e. then the predicate M{x\, . . . , x, x ) given by 

Mix, f n } = 2 4 '3-...p;^5 

is partially decidable. 
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tb) Let AcV; define A to be r.e. if the predicate "jeA' is 
partially decidable. Prove [hat A is r.e. iff 

{2*'3^< .,pfr:(xi xjeAHsr.e. 

(c) Prove that As ft," is r.e. iff .4 = or there is a total 
computable function /:&-»&" such that A = Rani/). (By a 
computable function f from M to N" we mean an n-tuple f = 

(/ /„) where each /, is a unary computable function and 

/u) = i/iU) /„(*)).) 

10. Suppose that f is a total computable function, A a recursive set 
and B an r.e. set. Show that f~ l {A) is recursive and that f(A), 
f\B) and f*(B) are r.e. but not necessarily recursive. What extra 
information about these sets can be obtained if f is a bijection? 

11. L'se the Rice-Shapiro theorem lo show that the following prob- 
lems are not partially decidable: (a) W x = 0\ lb) 'W x is finite', 
it) W x is infinite', yd) K S, =0". ie)'d>, *0\ 

12. Prove Rice's theorem (theorem 6-1.7) from the Rice-Shapiro 
theorem (theorem 2.16). {Hint. Suppose that '<£*€ 3T is deci- 
dable; then both & and ViVA satisfy the conditions of Rice- 
Shapiro: consider the cases fee 3! and f& £ $$.i 

13. (a i Let /C\> = {*:**U) = 0}and AT, ={x 6,(x)= 1}. Show that K a 
and K\ are r.e.. and that Ihey arc recursively inseparable, i.e. 
Kc^K; = and there is no recursive set C such that K Q =C 
and K"i c C; in particular neither K<, nor K ( is recursive, {flint. 
Suppose that there is such a set C and let m be an index for its 
characteristic Function: consider whether or not m € C.) (b) Show 
that two disjoint sets A. B are recursively inseparable lin the 
above sense) iff whenever A — W,„ B = W>> and W a n W B = 0, 
then there is a number ^W^uHi (MOT. Recursive 
inseparability for a pair of disjoint sets corresponds to non- 
recursiveness for a smgle set: pairs of recursively inseparable sets 
that are also r.e, correspond to r.e. sets that are not recursive.) 

3. Productive and creative sets 

Our chief concern in this section is to discuss a special class of r.e. 
sets called creative sets. These are r.e. sets whose complement fails to be 
r.e. in a rather strong way *l"hus we begin by considering a class of 
non-r.e. sets, among whose complements creative sets are to be found. 
Suppose that .4 is any set that is not r.e.; then if W s is an r.e. set 
contained in .4, there must be a number y$A\ W,. This number y is a 
witness to the fact that A = W x . It turns out thai for some non-r.e. sets it is 
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possible to find such a witness in an effective way. Consider, for example, 
the non-r.e., set K = {x.xi W r \. If W^sK, we cannot have x € W, (for 
then x$K, so W x £fC); hence *€^\.WV So x itself is a witness that 

W, * a:. 

The name productive is used to describe non-r.e. sets for which a 
witness can always be computed in this way. 

3.1. Definition 

A set A is productive if there is a total computable function g 
such that whenever W, c A, then g{x) s A \ W x - The function g is called a 
productive function for A. This is illustrated by fig. la. 

Example. The set K is productive, with productive function g{x) = x. 

Many examples of productive sets are obtained from the following 
theorem, which incorporates the idea of reducibility that was discussed in 
the previous chapter. 

3.2. Theorem 

Suppose that A and B are sets such that A is productive, and there 
is a total computable function f such that xeA iff fix) zB. Tiien B is 
productive. 

Proof. Let g be a productive function for .4. Suppose that W^cg. 
Then f~{ HV)£/~ (B) = A- moreover, / \ W, ) is r.e., so there is z such 
that r l (WJ = W : . Now W : c A, and so giz) s A \ W z> from which we see 

Fig. ~a. A productive set. 



Fig. Tb. Theorem 3.2. 





that fig[z'})GB\ W,\ i.e. figti)) is a witness to the fact that W x * B (fig. 

lb). 

We now need to obtain the witness fygiz)) effectively from x. A simple 
application of the s-m-n theorem provides a total computable function 
k[x) such that Wft, tl = /"'( W x ) (apply the s-m-n theorem to the function 
A*(/(y))). Then putting z — klx) we see from the above reasoning that if 
W, QB thcn/(g(fc(>l)) = B\ W.. Hence B is productive, with productive 
function f{g{k(x))). D 

3.3. Examples 

The following sets are productive: 

(«) {x:4**% 

(6) {x:c* W',} (c a fixed number), 

(c) {*:£££,} (c a fixed number). 
(For each of these sets apply theorem 3.2 using K and the functions 
obtained in theorem 6-1.4 (for (a)) and theorem 6-1.6 (for (61 and [c)).) 

The above examples of productive sets and many more may be 
obtained from the following general application of theorem 3.2, based on 
our proof of Rice's theorem. 

3.4. Theorem 

Suppose that $ is a set of unary computable functions with f& € $t 
and B9 * %-.. Then the set B - {x: tb x e $} is productive. 

Proof. Choose a computable function g£ SB. Proceeding exactly as in 
the proof of Rice's theorem (6-1.7) obtain a total computable function 
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£(*•) such ihat 

•>!,=£ if re /C, 

*!>k»>,^fc ifx~K. 
I.e. K^iff A[x)eS. By theorem 3.2, B is productive. U 

3.5. Example 

The set {v:«£, is not total} is productive, immediately from 
theorem 3.4. 

Our chief interest in productive sets is when they occur ;is The comple- 
ment of an r.e. set: 

3.6. Definition 

A <el A is creative if il is r.c. and its complement A is productive. 

The simplest example of a creative set is of course K. Using theorem 

2.6 we can say that a creative set is an r.e. set thai fails to be recursive in a 

very strong way. We will see in chapter 9 that there is a sense in which 

creative sets are the r.e. sets having the most difficult decision problem. 

3.7. Example* 

The following sets are creative 

[at {x:c(z Wji ;the complements of these sets were 

lb) (x.:c€£ x }j shown to be productive in examples 3.3). 

ir) The set A-=ix:^ x {x)^0\. Clearly A is r.e.; to obtain a 

productive function for A, use Ihe s-m-n theorem to construct a 

total computable function g such that 

<**<*j(y)-0 O 4>.(y »is defined. 

Then g(x)eA O g<*)r VV, ; so if W t -A we must have g(*)e 
A \ W s . Thus g is a productive function for A. 

Many examples of creative sets of indices are provided from the 
following application of theorem 3.4. 



3.8. Theorem 

Suppose thai ..-/. c: # : and let A - { x : A t c sf). If A is r.e. and 
A ■£ or fy, then A is creative. 

Proof. Suppose that A is r.e. and -4**0.U If foerf then A is 
productive, by theorem 3.4; this is a contradiction. Thus fz £ £?, so A is 
productive (theorem 3.4), hence A is creative. D 
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The examples 3.7(tr>. £&) could be obtained by immediate application 
of this theorem; similarly we have: 

3,9. Example 

The set .4 = {x: W x * 0} is creative: this set is obviously r.e. and 

corresponds to the set si = {/e **, \f*fa). 

Many of the exercises at the end of the section may be done with the aid 

of theorem 3.8. 

All examples of non-recursive r.e. sets that we have encountered so far 
are creative. (The reader might care to prove this for the examples that wc 
have not dealt with explicitly.) The question then arises as to whether all 
non-recursive r.e. sets are creative. The idea thai this might be the case is 
reinforced by theorem 3.8. and further examples in the exercises below. It 
turns out, however, that this conjecture is false : by a special construction 
we can obtain r.e. sets that are neither recursive nor creative. Section 4 
will be devoted to that task. 

The construction to be made m the next section is inspired by theorem 
3.11 below, which will show that a productive set land hence the 
complement of a creative set), although not itself r.e.. does contain an 
infinite r.e. subset. (The secret of constructing an r.e. set A that is neither 
recursive nor creative will be to ensure that A does noi have this 
property.) 

The proof of the theorem will be facilitated by first isolating the 
following technical result. 



3.10. Lemma 

Suppose that g ts a total computable function. Then there is a total 
computable function k such that for a!! x, W k , x] = W s >j{gix)}. 

Proof. Using the s-m-n theorem, take kix) to be a total computable 
function such that 

if ye Vv', ory = g(jl, 
(defined otherwise. Q 



* 



1 un; 



3.11. Theorem 

A productive set contains an infinite r.e. sublet. 
Proof. Let A be a productive set with productive function g. The idea is 
to enumerate without repetition an infinite set B = {>'■>, y i .--•} = A in the 
following way. 



U) Take e* HlCh thai W^=0; since W I() >=A, then gie )eA. Pul 

(2) For n^O, suppose ihat >o, • - • . y, have been given so thai 
{>Vh ...>?,,]£ A Find an index e ni such thai {>„, . . . , y,} = W^., s A. 
Then £(*„.,>£ A \ B^,; thus if we put y„,,= g(*„_ : ) we have y n . l eA 
and >„.! •* >'o, . . . , y„ <isee fig. 7c). 

To see Ihat this enumeration of y 3 , y u . . . is an effective one, we use 
lemma 3. HI. From the above discussion, when looking for the index e„~\ 
we require that 

W tm „ = W, n <j{y„) = W e „ u{g<>,)} 

(where k is the function given by lemma 3. 10). Thus wc may define e n -i to 
be k(e m ); then the sequence eo, f-., ... is given by the recursion equations 

e v = some index for 25. 

e*+t -*<>*}, 

and is hence computable. Now y„ = g\e m ), so the sequence y„, ) ; , ... is 
also computable. Thus B = {y . yj, . . .}, being the range of a compulable 
function, is r.e. By construction, B •= A and 8 is infinite. C 

For the record, we state the obvious 

3.12. Corollary 

If A is creative, then A contains an infinite r.e. subset. 

3.13. Exercises 

1. Show that the following sets are productive: 
(a) {x: W x is finite), 

Fig. 7c Enumerating an infinite subset of A (theorem 3.1 li. 
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ib) {x:$x is not surjeciive)-. 

(c) [x:$, is injective}, 

Id) {x:<Jf, is not a polynomial function}. 

2. Prove that the following sets are creative: 
la) {x:xsE.}, 

lb) {x:E', n *0}[n fixed). 

(c) {x:$, is not injective}, 

id) {.*:<*,U:)e A}, where A is any non-empty r.e. set. 

ie) [x: $„[■*) = /U)J, where / is any total computable function. 

3. Prove thai if B is r.e. and A^B is productive, then A is 
productive- 

4. Prove that if C is creative and .4 is an r.e. set such that 
A r\ C = 0, then C ^ A is creative. 

5. Prove that every productive set contains an infinite recursive 
subset. 

6. For any sets A, B define the sets A r £B and A® B as in exercise 
1.4(1 ). Suppose that B is r.e. Show thai \a ) if .4 is creative, theii 
so are A@B and A&B (provided B i* 0), 

(b) if B is recursive, then the implications in (a) reverse. 

7. Let 'M be a set of unary computable functions, and suppose that 
gs& is such that lor ali finite 0<^g, (*£$. Prove that the set 
{x:<jt t € $1 is productive. 

[Hint. Follow the first part of the proof of the Rice-Shapiro 
theorem.) 

8. Use the result of question 7 to show ihat ihc following sets are 
productive: 

[a) {.»::& is lotall, 

ib) [x:<tf x is a polynomial function J-. 

9. (Cf. exercise 2.18U3.U Disjoint sets .4. B are said to be 
effectively recursively inseparable it there is a total computable 
function / such that whenever A c W m B q W* and W a n W t = 
0, then ){a, b)£ W a u W b (see fiy. Id). 

Id) Prove that the sets Xn = {x:-St<>) = 0} and K\ = 
{x:<6,U) = 1; are effectively recursively inseparable. 
[Hint. Find a total computable function / such that if W« n W c = 
0. then 
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Fig. Id. Effectively recursively inseparable sew (exercise 3.1319]). 




{b) Suppose that A, B arc effectively recursively inseparable. 
Prove that if A, B are both r.e. then they are both creative. 
{Note. Extending the idea of effectiveness to a pair of reeursively 
inseparable sets in this way parallels the step from a non- 
reeursive set to a set having productive complement; the coun- 
terpart to a single creative set is then a pair oi effectively 
recursively inseparable sets that are both r.e.) 

4. Simple sets 

Our task in this section is to show that there are sets satisfying the 
following definition and hence (in view of theorem 4.2 below) to establish 
that not all non-recursive r.e. sets are creative. 

4.1. Definition 

A set A is simple if 

{a) A is r.e.. 

lb) A is infinite, 

(c) A contains no infinite r.e. subset. 

The idea in (b), (c) of this definition is to pinpoint some features of a set 
that are not possessed by any recursive or creative set. Thus, although as 
yet we have no examples of simple sets, we can easily see that 

4.2. Theorem 

A simple set is neither recursive nor creative. 



Proof. Suppose that A is a simple set. From t/it and Cc> of the 
definition, A is not r.e., so A is not recursive. By iheorem 3.11 and (cj of 
the definition. A is not creative. t_ 

The following construction of a simple set is due to Post. 

4.3. Theorem 

There is a simple set. 

Proof. We shall define a computable partial function /"such that the 
range of f contains at least one member from every infinite r.e. set. This is 
done by arranging that if <t>, is total and E„ is infinite, then fix)'' F,. To 
make Rani/} simple we must at the same time ensure that Rant/"} is 
infinite. We shall see that both conditions are met by the (unction / 
defined informally as follows: 

To compute fix}: compute (O^id. .>,(!;. .. . in succession (do not 
proceed to the computation of <£,( y t I ] unless and until 6, [y > has been 
computed) ; stop if and only if a number z is found such that <b t [z ) > 2x ; in 
that case put/Ut = £,Uj- (Formally we have/U»^*>,(jj-"(^iU)>2x»), 
demonstrating clearly that / is computable.} 

Put .4 — Ran(/"); then A is r.e. We now verify that A is simple. 

Suppose that B is any infinite r.e. set. Then there is a total computable 
function cS such that B = Ef,. Since B is infinite, the construction ensures 
that f\b) is defined and fih)e E B = B. Hence fl£ A. 

To see thai A is infinite, note that if fix) is defined, then /''*;> 2.*. 

Thus, for any r.. the members of A that are in the set {0, 1,2 In \ are 

among f{0), . . .,f{n — l). This means that A contains more than n 
elements, for any n. Hence A is infinite. D 

The construction o! a simple set is but the first and one of the easiest of a 
wide variety of constructions that yield r.e. sets with all kinds of special 
properties. These are beyond the seope of this book , the interested reader 
should consult a text such as Rogers [1967], where he will find r.e. sets 
rejoicing in names such a hypersimple, hypcrhypersimple, pseudocrea- 
tive, and maximal. (See also exercise 4.4(3! below for an example of an 
r.e. set that is neither recursive, creative nor simple.) 



4.4. Exercises 

1. Suppose that A andB are simple sets. Show that the set A® B is 
simple. (For the definition of® see exercise 1.4(1).) 



2. Suppose that f is a total injective computable function such that 
RanlX' is not recursive. (Exercise 2.18(7) showed that such 
functions abound.) Show that the set 

-4={*:3y(y>rand/(y)</U)» 

is simple ( Hint. To see that A is infinite, assume the contrary and 
show that there would then be a sequence of numbers y Q < y- ( < 
y 2 <- . - such that f(yo)>f{y-.)> f{y 2 )> - ■ ■ To see that A does 
not contain an infinite r.e. set B. suppose to the contrary that 
B eA Then show that the problem z e Rani/;* is decidable as 
follows. Given z, find nsB such that ftn )>z; now use the fact 
that nSA to devise a finite procedure for testing whether 2 € 
Ran(/).J 

3. Show that if A is simple, then A ®ftl is r.e.. but neither recursive, 
creative nor simple (see exercise 3.13(6)). 

4 ' t£l4' S k c s ' m P* e se,s - P rov * ( hat A®B is not simple but that 
AQ&B is simple. 
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Arithmetic and Godel's 

incompleteness theorem 



The celebrated incompleteness theorem of Godel [1931 J is one of many 
results about formal arithmetic that involve an interplay between 
computability and logic. Although full proofs in this area are beyond the 
scope of this book, we are able to outline some of the arguments 
discovered by Godel and others. We shall highlight particularly the part 
played by computability theory, which in many cases can be viewed as an 
application of the phenomenon of creative and productive sets. 

In §§ 1 and 2 we present some results about formal arithmetic that lead 
up to the full Godel incompleteness theorem in $ 3. In the final section the 
question of undecidabilily in formal arithmetic, already touched upon in 
5 1, is taken up again. Our presentation in this chapter does not assume 
any knowledge of formal logic, 



1. Formal arithmetic 

The formalisation of arithmetic begins by specifying a formal 
logical language L that is adequate lor making statements of ordinary 
arithmetic of the natural numbers. The language L has its own alphabet, 
which includes the symbols 0, 1, — , *, = (having the obvious meanings), 
and also symbols for logical notions as follows: -\ i.'not'l, * ('and'!, v 
I'or'), •* ('implies'), V ('for all"), 3 ('there exists 1 ), iln this chapter we will 
reserve the symbols V, 3 for use in L, and write the phrase 'for all* and 
there exists" when needed in informal contexts.) In addition, L has 
symbols x, y, z, . . . for variables, and brackets [ and ), and there may be 
other symbols besides. 

The statements (or formulas) of L are defined to be the meaningful 
finite sequences of symbols from the alphabet of /.. For instance, the 
statement 

3viyx(1+1) = x) 

is the formal counterpart of the informal statement 'x is even'. It is helpful 



to abbreviate the expression 1 + 1 by 2, (1 + 1) + 1 by 3. and so on (or all 
nalural numbers. Then the false informal statement *5 is even' would be 
expressed formally in L by the statement 

3ylyx2 = 5). 

We can similarly express in L formal counterparts of many informal 
statements of ordinary arithmetic: for 'at > y' we would write 

3z(-i(z = 0)A(y + z = x)). 

{The statement ^(z = 0) is often abbreviated by z *■ 0.) For 'x is prime' we 
would write 

• x P 0l a (x ?*T) a VyVz(x = y x z -> [ V = 1 v z= 11). 

Let us denote by if the set of all possible meaningful statements of the 
language /,. Then ¥ divides into two important sets, namely 

ZT= the set of all statements that are true in the 
ordinary arithmetic of N, 

S* = the set of all statements that are false in the 
ordinary arithmetic of h. 

Mathematicians would like to discover as much as possible about the 
set 'J. A natural question from the point of view of computabilily is 

( l.l)i» Is S recursive, or even recursively enumerable? 

Another question, important for the mathematician and philosopher 
alike is 

ll.l)(7>) Is there a simple-minded subset of .? (a set of axioms) from 
which all other statements in .? can be proved? 

We shall discover that the answer to both of these questions is no. 

Question 1.1(a) above can be made precise by means of a standard 
coding procedure. It is quite routine to specify an effective enumeration 
of the set $P t without repetitions, using a procedure similar to that used to 
enumerate programs in chapter 4. Let us assume that this has been done. 
and let us denote by d n the [#i + l)th statement of .'/in this enumeration, 
so that 

The effectiveness of this enumeration means that given n we can 

effectively find and write down the statement fl„, and conversely, given 
any statement it in cf we can effectively compute the code number n such 
that ir = B~ 
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This coding of statements is now used to code any set of statements 
by the set of numbers 

X = {n:0 n z%}. 



We say that if is 



recursive 




recursive 


r.e. 




r.e. 


productive 


if X is 


productive 


creative 




creative 


etc. 




etc. 



This gives the question 1 . 1 [a ) above a precise meaning. 

One of the key results that makes computability an extremely useful 
tool when investigating formal arithmetic is the following, due toGodel. 
we present it without any proof. 



1.2. Ijzmma 

Suppose that M(Xu -•■.*«) is a decidabie predicate. Then it is 
possible to construct a statement alxi, ...,x r ) of L that is a formal 
counterpart of M {x \, . . ., x„) in the following sense: for any a \, . . . , a, : EftJ 

M{a, a H ) holds iff ffffin a„)€^". 

Consider now the creative set K. By theorem 7-2.4 there is a decidabie 
predicate R{x, y) such that 

ie*; O there is > such that Rix.y). 

Applying lemma 1.2 to the predicate R {x, y) let us fix on one particular 
formal counterpart of this predicate, which we denote by ct k (x, y}. Then 
for any n£% the statement 3ycrft(n.yi is a formal counterpart for 
'n€K\ and — Bytr^ln.y) is a formal counterpart of 'neK'. Let us 
therefore write 

n*;K for 3ytrR(n, v) 

and 

n£K for ~3yo- H ir\.v). 
Then using lemma 1.2 we have immediately 

1.3. Lemma 

For any n =W 

la) neK iff neKe 3 
Kb) n£K iff n£Ke#" 

We are almost ready to answer the question l.liu.) above; we shall 
need the following lemma. 



1.4. Lemma 

There is a total computable function g such thai for ait n. d Kint is 
n«K 

Proof. This is immediate from the effectiveness of the coding of 
statements, since given r. we can effectively write down the statement 
nt= K (= — 3y«7jiin. y)). J 

Now we have, in answer to question 1.1(a): 

1.5. Theorem 

F is not m.; in fact 3 is productive. 
Proof. LclT = {n:$ H c T)\ taking g as in lemma 1.4 we have 

r.€K » n £ K 

O n e K e & (by lemma 1.3), 
» gin ) € T (by lemma 1.4). 

So. since K is not r.e.. neither isT. In fact, by theorem 7-3.2 we sec that IT 
is productive. □ 

1.6. Exercise 

Show that & is productive. 



2. Incompleteness 

A simple version of Gddel's incompleteness theorem follows 
easily from theorem 1 .5. We must first describe the setting of this famous 
result. 

Consider the second question 11.1(A)) posed in § I. This question is 
made precise by using the idea of a formal system. A formal system 1st, SM 
(for the language L) consists of a set sf ~ if (the axioms ) and an explicit 
definition •J, of the notion of a formal proof of a statement in y from these 
axioms, satisfying the conditions: 

(2.1) ifl) Proofs are finite objects (hence capable of being coded), 

(b) The explicit definition & of proof is such that if ,« is recursive 
then the relation 

7> is a proof of the statement o* from the axioms .«' 

is decidablc. 

We can now interpret the question 1.1(6] as asking whether there is a 
formal system for L such that 

(2.21 (a) rf is recursive (so we are taking simple-minded in a fairly 
wide sense), 
[b\ The provable statements are precisely those in a. 



The condition (o) poses a problem for the philosopher who may be 
trying to define the very notion of arithmetic truth by means of a formal 
system. For him. this condition is meaningless, and must be replaced by 
conditions reflecting some of the properties to be expected of truth, such 
as 

i2. 2)ib')Consistency\ there is no statement a such that both tr and ~iv 

are provable, 
i2,2)ib"'fCompieteness: for any statement tr, either tr is provable or — cr is 

provable. 

A simplified version of Godel's theorem shows that there is no formal 
system of arithmetic satisfying the conditions 2.2(a i and {b). This is easily 
derived from theorem 1.5, and is given below. The full theorem of Godel 
[1931] together with its improvement by Rosser shows that there is no 
formal system of arithmetic (of a certain minimal strength) satisfying 
conditions 2.2(a) and (b% (ft"), In other words, any consistent formal 
system of arithmetic having a recursive set of axioms is incomplete. This 
will be proved in § 3. 

We shall need the following lemma to establish the simplified Godel 
theorem. 

2.3. Lemma 

In any recursively axiomatised formal system the set of provable 
statements is r.e. 

Proof Let 3ft be the set of statements in 9 that are provable. Since 
proofs are finite, they can bcerTcctivcly numbered; then if si is arecursive 
set of axioms the predicate 

Mix, y) = 'y is the number of a proof of y, from the axioms -rf' 

is decidable, by (2.1 )(>). Then 

fi t is provable « there is y such that Mix, y ) holds. 
Hence, by theorem 7-2.4. &t is r.e. 7^ 

Now we have 



2.4. Theorem. (The simplified Godel incompleteness theorem) 

Suppose that (,s/, ii) is a recursively axiomansed formal system in 
which all provable statements are true. Then there is a statement tr that is 
true but not provable {and consequently ~ \tr is not provable either). 



Proof, By lemma 2.3, the set &t of provable statements is r.e.. and wc 
arc given that 5>* s F. Now & is not r.c. (theorem 1.5) so we immediately 
have a statement <rs $\&*\ i.e. o- is true but not provable. Clearly — tr is 
not provable either (otherwise -w would be true). □ 

(Using the productiveness of J (theorem 1.51 we could strengthen this 
theorem to say that the statement a can be obtained effectively from a 
specification of the formal system (which would yield an index for &t).) 

To aid an understanding of the proof of the full Godel theorem in § 3 it 
is useful to examine the inner working*, that were hidden when we 
applied theorem 1 .5 in the above proof to obtain the statement cr. 

Let us say that a statement is refutable if its negation is provable. 
Consider the sets of numbers Pr* and Ref* given by 

Pr* = {n : n e K is provable}. 
Ref* ={n: n e K is refutable) 
— \n : n e K is provable} 
= {n:0t: l ,,€&*l 
(where g is the computable function given by lemma 1 .4 and used in the 
proof of theorem 1.5). The assumption that provable statements are true 
means in particular that Pr* c K and Ref" c K. Now Ref* is r.e. (from the 
fact that n € Rei*&0 K(n > e £»,, and 9i is r.e.). so there is a number m 
such that Ref* = W ln , 

By the productiveness of K we have immediately that meJORef*. 
i.e. m£ K, and m £ K i>- not provable. Taking tr to be the statement m £ K 
we thus see that v is true but not provable (and -iw is not provable, as 
before). The argument is illustrated by fig. 8a. (For comparison with the 



Fig. 8a. Simplified Code! incompleteness (theorem 2.4!. 




proof of the full Godel theorem in the next section, note that the 
non-provability of —ttr can be seen as a consequence of the fact that 
?t*QK: for m£K (as above), so m£Pr*, i.e. m€K is not provable. 
Then, by the rules of formal proof -im^K (i.e. -iw) is not provable.) 
Notice now the intended meaning of the statement v thus obtained: tr 
is the formal counterpart of the statement m £ K, i.e. m £ W m . But we have 
me W m O m£ Ref* 

O rr> ? K is not provable 
O <t£$>: 

Thus <r is a formal counterpart of the statement *<r is not provable'; i.e. 
speaking rather loosely, <r says 'I am not provable'. This is reminiscent of 
the paradox of the liar, involving the informal statement 

A = Tam lying*. 

Informal reasoning about A results in the paradox 

.1 is true iff A is not true. 

If the same informal reasoning is applied to the informal statement "I am 
not provable' the paradox is avoided by the conclusion that provable is not 
the same as true. This informal conclusion is rigorously justified by the 
proof of theorem 2.4. 

3- Godel's incompleteness theorem 

We proceed in this section to show how the idea behind the proof 
of theorem 2.4 can be refined so as to avoid any reference to truth. 

For the moment we fix on a particular formal system of arithmetic 
known as Peano arithmetic. The axioms for this system consist of a 
recursive subset of 5* known as Peano' s axioms x these reflect the simple 
properties of the successor operation on FsJ, and the recursive definition of 
addition and multiplication in terms of it, together with an axiom scheme 
reflecting the principle of induction on %. The notion of a formal proof is 
taken as that denned for the first-order predicate calculus. Full details of 
Peano arithmetic (sometimes called formal number theory) may be found 
in any textbook on mathematical logic. For our purposes, the important 
fact we need to know about Peano arithmetic is given by the following 
lemma, to which a substantial part of Godel's proof is devoted. 



3.1. Lemma 

LetM[Xi x„) be a decidable predicate, and let a{X\ X„) 

be the statement of /. that is the forma! counterpart of M{x,, .... X„) as 



given by lemma 1.2. Then M is represented in Peano arithmetic in the 
following sense - for any a lt . . . ,a„eW 

(a) ifMyau fln) holds, then rr(a,, ... . , a„) is provable, 

(/») tf M{a u . . . , a,) <&>« no/ AoW, rfien -i<r(a,, . . . , a„} a 
provable. 

(For a proof refer to a textbook such as Mendelson [1964].) □ 



Consider now the statement n e K (i.e. 3yoft(x, y)) that we took in § 1 
as a formal counterpart of the statement n € K. Then from lemma 3.1 we 
can obtain 



3.2. Corollary 

For any natural number n, ifn € K then fl€ K is provable m Peano 
arithmetic- 
Proof Suppose that n € K. Then there is a natural number m such that 
R in, m) holds, so by lemma 3.1 we have that tr R (n, m) is provable. The 
rules of the predicate calculus are such that we can immediately find a 
proof of 3y<r R (n, y); i.e. n s K is provable. 

For part of his proof. Godel needed an extra technical condition called 
^-consistency: a formal system is said to be co-consistent if there is no 
statement Wy) such that all of the following are provable: 

3yr(y), -ir<0), -tt(1), -t(2}, . . . 

I to -consistency is a stronger condition than consistency (2.2)(h')). 

We can easily dehvc the converse of corollary 3.2 from lemma 3. 1 . with 
the assumption of w-consistency. 



3.3. I^emma 

Suppose that Peano arithmetic is oj-consistent; then for any natural 
number n,i/neK is provable then n = K. 

Proof. Suppose that n&K, then for every m =H we have that R(n,m) 
doc* not hold, so by lemma 3.1, -(m(n t m) is provable. Thus, if ns K is 
provable but n£ K, all of the following are provable 

By-TRin.yi, -irr R (ru 0), -i<7 R (n. 1), .. . 
in contradiction of w-consistency for the statement r(y) = o- R {n, y). J 



We can now present a proof of 



3.4. 



Proof. 



Theorem i.Godel's incompleteness theorem [1931]) 

There is a statement a~ of L such that 

(a) if Peano arithmetic is consistent, then y is not provable, 

ib) if Peano arithmetic is on-consistent, then -^ & is not provable. 

Recall the sets Pr* = {n : n e K is provable}. 
Ref* = {n : n e K is refutable}, 
that we defined in the discussion at the end of the previous 
section. By corollary 3.2 we have K sPr*; consistency implies 
that Pr*nRcf* = 0, and so Ref*c/f, We can now argue as 
before: Ref*isr.e..sotakem such that Ref" = W m . The situation 
is illustrated by fig. 86. which should be compared with that in 
fig. 8a. 

By the productiveness of K, we have that m s AT \Ref * ; in 
particular, m £ Ref* means that m £ K is not provable. Hence (a ) 
is established, by taking it to be the statement m £ K. 
Kb) The condition of ^-consistency implies (by lemma 3.3) that 
Pr" c K, and hence Pr* = K. Thus, with ^-consistency, fig. 86 is 
modified to become fig. 8c. Thus m£K means that mgPr*; i.e. 
m € K is not provable. The rules of the predicate calculus tell us 
immediately that -i<r (i.e. -im £ K) is not provable. Z\ 



Notes 
1. The statement *r produced by Godel s theorem is called an undeci- 
dable or an undecided statement of Peano arithmetic. As discussed at the 



Fig. Si>. Godel incompleteness (theorem 3.4(a)). 




Kip. Ke. Godel incompleteness (Iheorem 3.4 (b)). 




end of S 2, a has ihe informal meaning 'I am not provable', and is, on an 
intuitive level, true. 

2. Clearly Godel's theorem applies to any recursively axiomatised 
formal system in which ail decidable relations can be represented fin the 
sense of lemma 3.1). In particular, this is true for any such system that is 
stronger than Peano arithmetic. In consequence, there is no way to avoid 
the incompleteness phenomenon by adding new axioms: for example <r 
or -i<r. The resulting formal system would have a new undecided 
statement. 

3. Note that the undecided statement <t can be constructed explicitly 
from a specification of Peano arithmetic, since from such a specification, 
we could effectively find an index m for Ref*. This constructive aspect of 
Godel's theorem is a consequence of the fact that K is creative. An 
analysis of the proof would show that we can demonstrate the mere 
existence of an undecided statement using any non-recursive r.e. set A in 
place of K. 

4. Although not entirely clear from our presentation, the proof of part 
\a) of Godel's theorem is a finiiist proof: that is, it shows explicitly how, 
given a formal proof of the statement a, to construct a proof of ~cr (thus 
demonstrating inconsistency). We cannot make the same remark about 
{b}, because w-consistcncy is not a finitist notion. 



In 1936 J. B. Rosser saw how to eliminate the assumption of in- 
consistency in part (b ) of Godel's theorem. We shall now see that Rosser's 
refinement of Godel's method can be viewed as an application of the 
effective recursive inseparability of the r.e. sets 

Kt, = {x : <*>,{ x ) = 0} and A'i = {x : <£, (x ) = !} 



(that we discussed in exercise 7-3.13(9)), in place of the use of the 
creative set K. (Our treatment below does not assume familiarity with this 

exercise.) 

We begin by describing some statements of y that are formal counter- 
parts oi the statements n € Ka and n e K x ; these are slightly more complex 
than the formal version of n ■= K used earlier. Select decidable predicates 
R v (x, y) and Ufa y) such that 

n € K c » there is y such that R {n, y) 

and 

n € Ki <=> there is y such that Riin, v). 
Now clearly K 3 n /Ci = 0, so we also have 

(*) n s Ko 4=> there is y such that (i) R {n, y) and 

(ii) for all z ^ y, Rln, z) does not hold, 

and there is a similar equivalence for n = K\. Now take statements a^, 

(Tjfc representing R$, R\ in Peano arithmetic as given by lemma 3.1. 

Rosscr's trick was (essentially) to use the following statement (based on 

(*) above) 

("*) Bvlo-^n, y)AVzsy(-irTj,,tn,zH) 

as the formal counterpart of n sK.y, rather than the simpler statement 

3Yff*J.n. Y''. Let us wrilc n € K for the statement (*") above. Similarly we 

write n € Ki for the statement 

3Y(<r Rl (n,y)AVz<v(~>«- Ro (ri, z))). 

Now it is quite straightforward to establish the following key lemma 
(which should be compared with corollary 3.2): 



3.5. Lemma 

In Peano arithmetic, for any natural number n 

(a) ifne Kc, then n e Ko is provable, 

(b) if n € K\, then n € K| is provable, 

(c) if n e Ki is provable, then n e K c is also provable. 



The proof of this lemma uses some technical properties of Peano 
arithmetic, and we therefore omit it. It is to obtain 3.5(e) particularly that 
the more complex formal representations of n e Ko and n € K\ are 
needed. (For those familiar with mathematical logic we should mention 
that lemma 3.5 is easily established once the following statements have 
been shown to be provable in Peano arithmetic: 



(.3.6) (a i For any m e N: 

Vz<m(z = 0vz = 1 v. . . vz = m). 
(b) VyVztyszvzsy}.) 

We can now complete the proof of 

3.7. Theorem (The Godel-Rosser incompleteness theorem) 

There is a statement r such that ifPeano arithmetic is consistent, 
neither r nor —it is provable. 
Proof. Define the sets 

Pr** = {n : n e K u is provable} 

Ref*" = (n : n = K* is refutable; 

= {n : n £ K,, is provable). 

Consistency means thai Pr** r, Ref** = . 
From lemma 3.5(a) we have 

ATocPr**. 

Also, for any n, combining lemma 3.5(A) and lc) we have 

neK : ^* n £ Ko is provable ; 
i.e. 

K,cRef*-. 

Now Pr** and Ref** are both r.e. (this uses the fact thai &* is r.e.l so the 
recursive inseparability of K c and K, (exercise 7-2.18(13*)) means that 
there is a number pi Pr"* u Ref* *. The state of affairs is illustrated in fig. 
8d Now p£ Pr** means that p € K c Ls not provable, and p£ Ref** means 



Fig. 8rf. Gbdcl-Rosser incompleteness (theorem 3.7), 




•* L/naeciaaniiiiy 



that p 2 K is not provable, so the theorem is established, by taking t to be 
the statement pe K c . 

Although the proof of the theorem as slated is complete, lei us now see 
how the numper p (hence the statement r) can be explicitly constructed. 
From an explicit specification of Peano arithmetic, we can effectively find 
an index p such thai 

fl ifnsPr-*, 

<£„<«) = <0 ifne Ref**, 

[undefined otherwise. 

We can now see that /iS Pr** ^ Ref**, as follows: 

(i) if pePr**, then cV,(p) = l, so peX",. hence peRet**, 
contradicting consistency. Hence pe Pr*". 
(ii) if p € Ref**, then <t> yp) = 0, so p e Ko, hence p e Pr**, ano- 
ther contradiction. Hence p£ Ref*. 

<;The fact that p can thus be obtained explicitly uses essentially the 

effective recursive inseparability of K» and K\ (see exercise 7- 

3.13(9).) D 

Notes 

1. The statement -it constructed in this theorem corresponds to the 
undecided statement ir of theorem 3.4; it is easily seen that - r also has 
the informal interpretation I am not provable', and is intuitively true. 

2. The Godel-Rosser theorem applies to any recursively axiomatised 
formal system of arithmetic in which all decidable relations can be 
represented and for which lemma 3.5 can be established. iLemma 3.5 
always holds for systems in which statements 3.6 [a ), lb) can be proved: 
such systems arc called Rosser systems.) Again, there is thus no possibility 
of avoiding incompleteness by adding new axioms. 

3. The Godel-Rosser iheorem is a completely finitist Theorem: ihc 
proof (when given in full detail) shows how to demonstrate inconsistency 
explicitly if we were given a proof of cither r or ~r. 

4. Undecidabillty 

We have already seen that the set $ of true statements of 
arithmetic is not recursive (theorem 1 .5): this is often described by saying 
that :T is undeadabie. In general, when considering sets of statements the 
terms decidable and undeadabie are often used to mean recursive and 
non-recursive. 

We can ask particularly of any formal system of arithmetic, is the set #> i 
of provable statements decidable? The answer is invariably no, and there 
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arc various ways to see this. We confine ourselves to one of the many 
results in this area, using the ideas of the previous section. 

4.1. Tlieorem 

Suppose that {&, 3 I is an to-consistent forma! system of arithmetic 
in which all dtcidahle predicates are representable (in the sense of lemma 
3.1). Then the set of provable statements is creative. 

Proof. The assumption of the theorem means that Godel's theorem 3.4 
applies, so in particular we have From the proof of theorem 3.4: 

K = Pr* = [n : n e K is provable}. 

Now let Pr = {«: $„ is provable}; we can find a computable function h such 
that n € K is &y r .,, and then 

n e K o n e Pr* 

O h[n)e?r. 

So by theorem 7-3.2, Pr is creative. C 

4.2. Corollary 

If Peano arithmetic is <o-consistem then the provable statements 
form a creative set. [This is the case in particular if all provable statements 
are true.) 

The counterpart to theorem 4. 1 and corollary 4.2 using Rosser's ideas 
is given in the following exercise. 

4.3. Exercise 

Suppose that (si,B) is a consistent recursively axiomatised 
formal system for which lemmas 3.1 and 3.5 hold. Let Pr" and Ref** be 
the sets defined in the proof of theorem 3.6. 

(a) Show that Pr** and Ref* are effectively recursively 

inseparable. 

(» Let Pr = {n: ft, is provable} and Ref = {n: -tff n is provable}. 

Prove that Pr and Ref are effectively recursively inseparable. 

{Hint. Extend the idea of theorem-7-3.2 to pairs of effectively 

recursively inseparable sets.) 

The presentation of the results in this chapter is derived largely from 
the books of KleeneII967]and Smullyan [1961^. For further discussion 
of incompleteness and undecid ability in arithmetic and related areas, the 
reader is referred to Bell & Machover ( 1 977 J, Boolos & Jeffrey [ 1 974], or 
Rogers[1971]. 



Reducibility and degrees 



In earlier chapters we have used the technique of reducing one problem to 
another, often as means of demonstrating undecidability. We did this, for 
instance, in the proof of theorem 6-1.4 by showing that there is a total 
computable function k such thai x e W, o <St!,. = 0, i.e. we used the 
function k to transform or reduce each instance of the general problem 
'x *r W, ' to an instance of the general problem 'tfr x = 0'. In this chapter we 

consider two ways of making the idea of reducibility precise, and for each 
we discuss the associated notion of degree (of difficulty) that arises. 

It is more convenient to deal with reducibility between sets rather than 
Between problems* remembering that any problem is represented by a set 
of numbers. The informal idea of a set A being reducible to a set B can be 
expressed in various ways; for instance 

(fl) "Given a decision procedure for the problem 'x si?', we can 

construct one for 'x c~ .4'." 

(b) Tor someone who knows all about B, there is a mechanical 
procedure (that uses his knowledge of B ) for deciding questions 
about A.' 

(c) 'Questions about A are no harder than questions about B.' 
id) "The degree of difficulty of the problem 'x € A' is no greater 
than that of the problem 'x s B'.' 

It turns out that there are several non -equivalent ways of making this 
idea precise. The differences between these consist in the manner and 
extent to which information about B is allowed to be used to settle 
questions about A. In §§ 1-3 we shall investigate one of the simplest 
notions of reducibility, called many-one reducibility. which includes all of 
our earlier uses of the informal idea. In the final sections we shall discuss a 
more general notion known as Turing reducibility. 
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1. 



Many-one reducibiiity 



1.1. Definition 

The sel A is many-one reducible (abbreviated m-reducib!e\ to 
the set B if there is a total computable function / such that for all x 

xzA in" f(x)eB. 

We shall write this A <„,i?;andweshallwriie/: A £„,fl to indicate that/ 
is a total computable function demonstrating that A ^ m B. 
Note. The phrase many-one is used to distinguish this kind of reducibiiity 
from a related notion called one-one reducibiiity, for which the function f 
is required to be infective. 

We have used in- reducibiiity implicitly on many occasions in earlier 
chapters. The s-m-n theorem is often needed to establish many-one 
reducibiiity, as we see in the following examples. 

1.2. Examples 

1. In chapter VI we showed that K is m-reducible to each of the 
following sets: 

{a ) {x : 4>, — 0} (theorem 6- 1 .4. quoted above ), 
(b) {x:c€ W x '> (theorem 6-1.6). 

2. If we examine the function k given in the proof of theorem 6-1.6 
we see that ieK O d>k,x> is total. Hence 

k:Ks m \x:<bi is total). 

3. Rice's theorem (theorem 6-1.7) is proved by showing lhat 
K s m f.t : d>, e B$}. where £t is any non-empty subset of *€% such 
that/a££. 

4. {*:<fcisiotal}fi m {;c:.k r = 0}. 

Proof. Using the s-m-n theorem obtain a total computable 
function k such that it> k , =0»<Ji„ for all x. Then 

k : {x : *»is total} &„ {*:#» = 0}. 

The following theorem gives some of the elementary proper- 
ties of m -reducibiiity. 



1.3. Theorem 

LeiA.B, C be sets. 

la 1 ^ m is reflexive ( i.e. A ^ o; A) and transitive [i.e. if A ^ m B and 

B<£ m CthenA* m C), 

lb) A£„BiffA£ m B t 



1 Many-one reducibiiity 



159 



(c) if A is recursive and B ^ m A, then B is recursive, 
id) if A is recursive and B j 6 0. fa, then A < m B, 
ie) if A is r.e. andB^^A, then B is r.e., 
if) (i) A^ m UiffA = K 

(ii) A^ m Z iff A = 0, 
(g) (i) M* m AigA*0, 
(ii) 0s m A#.A*N. 
Proof 
ta) Reflexive, i: A < m A,wherei is the identity function. Tran- 
sitive. If /: MsJ and g: B £ m G, then clearly g«f;A ^ :0 C. 
1ft) Ug:A< m B, ihenx€A to g{x) e S ; hence x € A to g(x)e 
B; hence v-.A-z^B. 

(c) Suppose that g:ff =s m A; then c B (x) = c A (g(x)), so c B is 
computable. 
id) Choose b € B and ce B. and define / by 

\c ifx?A. 

Then f is computable (since A is recursive!, and »e.4» /(* ) s 
B; hence/: A ^ m ft 

(?) Suppose that g:B< r ,A and A = Dom(ft), with h compu- 
table; then F = Dom(A«g). and A*g is computable, so B is r.e. 
if) («) By i», Ns B V Conversely, suppose (hat/:A£ m N; i.e. 
ieAo /(,t » s N. Then clearly .A = fol. 



vii) is dual to (i): /1< 1I to A 



£>A = h<*A = Z. 



(g) (i) Suppose that f:M^ m A; then A -Rani/), so A * 
(since / is total). Conversely, suppose lhat A >* 0, and choose 
ct A. Then if wc define glx) = c (ail *), we have ^:M< m A. 

(ii) is dual to ;i): 0s m A to \^*,A to A/0 to A?*V D 



From (^) of this theorem we obtain the following example of non- 
re ducibility: 



1-4. Corollary 

Neither of the sets {x : <*, /s ftwaJfc [x : 6* is not total) Is m-reducible 
toK. 

Proof. From corollary 7-2.17 neither of these sets is r.e.; apply 
theorem 1.3(e). U 
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The exceptional behaviour of the sets 0,& as given in theorem 1.3(d). 
{ f), (g) is part of the price thai has to be paid for the simplicity of the 
notion of m-reducibility. Another rather unsatisfactory feature is that ihc 
sets A and A arc not necessarily inter -reducible (contrary to the intuition 
that the problems 'i e A' and K x£A' should be equally difficult), as we 
now see : 

1.5. Corollary 

If A is an r.e. set that is not recursive, then A& m A and A •Z-nA. 
Proof. By theorem \,3ie)ifAs m A,thenA is r.e.. a contradiction. For 
A £ n A, use theorem 1.3(A). □ 

The next result shows again the key role played by the r.e. set K. 

1 .6. Theorem 

A set A is r.e. if and only If A^ m K. 
Proof. If A S m K, then theorem 1.3(e) tells us that A is r.e. Conversely 
let A be any r.e. set. Define a computable function fix, j ) by 



[1 ifxeA, 

*' Undefined ifxtiA. 



The s-m-n theorem gives a total computable function six) such that 
fix, > ) =■ «?,<,i(y). It is clear from the definition of / that 

x€A ** (k. j: (iU() is defined 
« $(x)t=K. 

l.e.A^„K. D 

This theorem may be interpreted as saying that the problem 'x<= K' h 
the most difficult partially dccidable problem. 



1.7. Exercises 

1 . Show that A' is m-reducible to each of the following sets: 
{a) {x:<f>Ax) = 0), 

(A) {x:xeE x }> 

2. Show that for any sets A, B, if B * then A^ m A®B.\ Recall 
thati4®S-{n-(a ( b)\ as A, baB\.\ 

3. Show that 

[a] {x:tb s -Q)^ m {x:<^ t is total and constant). 
[b\ {*:*, is total}^ m {jr: W, is infinite}. 



2 Decrees 



161 



4. Show that none of the sets in exercise 3 above is m-reducible to 
an r.e. set. 

5 . Suppose that .4, B are r.e. sets such that A «_> B = M and Ar\B* 
0. Prove that A * m Ar\B. 

2. Degrees 

For any notion of reducibility there is an associated notion of 
equivalence between sets: this corresponds to the informal idea of two 
sets or problems having the same degree of difficulty. Thus, for m- 

r-ducihilitv wc have: 



2.1. Definition 

The sets A and B are many-one equivalent (abbreviated m- 
equivalenl) \t A^ m B and B^ m A. We write this A* m B. 

The use of the word equivalent in this definition is justified by 

2.2. Theorem 

The relation - m is an equivalence relation. (See Prologue § 3 for 
definition.) 

Proof. Rcflexivity and transitivity follow immediately from theorem 
1.3(a ): symmetry is obvious from the definition. □ 

2.3. Examples 

1. Letc be any number; then (x:ce WJ^K, by example 1.2116) 
and theorem 1.6. 

2. For every recursive set A other than 0. fa, we have A **„ A by 
theorem 1.3(d). 

3. If A is r.e. but not recursive, then A ^ m A. by corollary 1.5. 

4. {x:<!t x = Q}= m {x:d>, is total}. One half of this is given by example 
1.2(4); to see the reverse reduction, use the s-m-n theorem to 
obtain a total computable function k such that 

lundehned otherwise. 
Then clearly *,=llo <£*„, is total. 

For any set A, the equivalence class of A under the relation = ai is the 
class of sees d,n(i4 ) given by 

This can be thought of as the class of all those sets having the same degree 
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of difficulty (with respect to s m ) as the set -4; hence d„(A» is called the 
m-degree of A. 

2.4. Definition 

An m-degree is an equivalence class of sets under the relation 
= m \ i.e. it is any class of sets of the form dmiA) for some set A. 

H is conventional to use lower case bold face letters such as a, b, c to 
denote degrees. 1 It is worth making a strong mental note that although 
lower case letters are used, these are sets of sets. Thus it is meaningful to 
write A = a, where a is a degree and A is a set, although at first this may 
appear a little odd. 

The relation s m on sets induces a partial ordering (see Prologue ?> 3 for 
definition) on m-degrees, also denoted =£ m , as follows: 

2.5. Definition 

Let a, b be m-degrees. 

(a) a^ m b if there are Asa and B<i b such that A& m B, 

(b) a< x b if a^ m A butarb. 

Nate. It is immediate from the definition of = ia that a^ a b\dA s A H for 
every A&a,B<kb. 

2.6. Theorem 

The relation <„ is a partial ordering of m-degrees. 
Proof. From theorem 1.3(a) wc have immediately that a ^, :i a 
(reflexivity)andthata ^ m b,b ^ m cimplies<i £ w c (transitivity). Suppose 
now that a^ ;0 b and b^ :a a. We have to show that a -b. Let Aza and 
Be 6; then from the definition wc have A s„B andB ^A, so A = m B. 
Hence a — b. Zl 

The name recursive m-degree is given to any m -degree that contains a 
recursive sel; similarly, an r.e. m-degree is one that contains an r.e. set." 
We can translate parts of theorem 1.3 and theorem 1.6 into the language 
of decrees as follows. 

2.7. Theorem 

[a) {0} and \N) are m-degrees, which we denote by o and n 
respectively ; o and a are recursive m-degrees. 



Although we have also used a on occasions iu denote an st- tuple (c : 
aintcxl will resolve any po«M<iic amhipiity 



. . . a„i, the 
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ib) There is one other recursive m-degree. denoted m , that 

consists of all recursive sets except and H, moreover, O m s m a for 

any m-degree a other than o, n. 

(c) For any m-degree a. we have o=£ m a provided a*n, and 

a s m a provided a^o. 

id-) Any r.e. m-degree consists only of r.e. sets. 

ie) If a ^ m b and b it an r.e. m-degree, then a is also an r.e. 

m-degree. 

if) There is a maximum r.t. m-degree. namely d m iK), which is 

denoted Om- 

(a) Follows from theorem l.3(/); 
ib) from theorem 1.3(c), id); 
ict from theorem 1.3(g): 
id) from theorem 1.3(e); 
ie) from theorem 1.3(e); 
if) from theorem 1.6. ~2 



Theorem 2.7 gives us a picture of the m-degrees as shown in fig. 9a. (In 
this diagram, we position a degree a below a degree b to indicate that 
a ^K,b.) We shall see later las this picture suggests} that there are r.e. 
m-degrees other than m and 0„. 

The structure of the collection of m-degrees under their partial order- 
ing has been studied extensively. The following theorem means that this 
structure is what is known as an upper semi-lattice. 

Fig. 9a. The m-degrees. 



non 
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2.8. Theorem 

Anypairof m-degrees a, b have a least upper bound; i.e. there is an 

m-degree c such that 

(i) a < m e and b s m c (e is an upper bound), 
(ii) c s m any other upper bound of a, b. 
Proof. Pick A e a, B € b and lei C - A Q B, i.e. 
C = {2x:xeA\<j{2x + l:x<=B}. 

Then x e A o 2x s C, so A <^ C, and x e 5 « 2x + 1 e C. so S < m C 
Thus, putting e = d m (C) we have that c is an upper bound of a. b. 

Suppose now that d is an m-degree such that a '^ m d and b ^ m d- 
Choose a set D~d. and suppose that/: A ^ Bi D andg: B <„,£>. Then we 
have 

jtCOU iseven&|xeA)or (xisodd&Ju-DeB) 

<& {x is even &/&* > = £>) or (* is odd & g(k* - 1)) e D) 
Thus we have h:C~= m D if we define h by 
_ [/(a*, t if x is even. 

[g(i(x ~ 1)1 if x is odd. 
Hence c^„d. □ 



*(*; 



It is clear that the least upper bound c of any pair of m-degrees a, A is 
uniquely determined; moreover, it is easy to see that if a, b are r.e. so is c 
(see exercise 2.9151 below). 

When considering the structure of the m-degrees, it is natural to 
examine in particular the structure of the r.e. m-degrees. (These include, 
of course, the recursive m-degrees in ,o, n.) We have already seen in 
theorem 2.7 (and indicated in fig. 9a ) the following basic facts about r.e. 
m-degrees: 

{a) if we ignore the exceptional m-degrees o, n there is a 

minimum r.e. m-degree m (in fact K is minimum among all 

m -degrees); 

lb) the r.e. m-degrees form an initial segment of the m-degrees; 

i.e. anything below an r.e. m-degree is also r.e. 

ic) there is a maximum r.e. m -degree - namely 0^,. 
Moreover, it is easy to see that while there are uncountably many 
m-degrees, only countably many of these are r.e. (exercise 2.9!6) below). 
It has emerged from much research over the past twenty-five years that 
the structure of the r.e. m-degrecs is exceedingly complex. Within the 
scope of this book it is only possible to show ihat it is not completely 
simple; this we shall see in the next section. 
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2.9. Exercises 

1 . Show that each of the following sets is m-equivalcnt to K: 
ia) {x:xeE,}, 

{b) {x:4,(x>-0). 

2. (a) Show that A =„. A ® N for any set A, 

[b) Let B be a non-empty recursive set. Show that A *„A®B 
for any A provided that A * H. 

3. (Cf. examples 2.3(2,3)0 Is it true that if A* m A then A is 
recursive? (See exercise 5d below.) 

4. Show thai the following sets all belong to the same m-degree: 

(a) {*:<£, =0), 

(b) {x:<i> x is total and constant}, 

(c) {x: W, is infinite}. 

5. Let a, b be m-degrecs. 

'.fli Show that the least upper bound of a. b is uniquely deter- 
mined; denote this by a ^ b , 
ib ) Show that if a s m b then a \j b = b ; 
(c) Show that if a, b are r.e., then so is a vb\ 
id) Let Asa and let a* denote d„{A). (Check that a* is 
independent of the choice of At- a.) Show that [a ^fl*i* = 
aua*. 

6. [a) Show that any m-degree a is denumerable (i.e. there are 
denumerably many sets A€a). 

lb) Show that there are uncountably many m-degrees. 
If) Show that there are countably many r.e. m-degrees. 



3. in-complete r.e. sets 

We have seen that fl„, the m-degree of K is maximum among all 
r.e. m-degrees. This is also described by saying that the set K is an 
m-complele r.e. set, or just an m-complete set} {There is a corresponding 
notion for any other kind of reducibiliiy.) 

3.1. Definition 

A set is m-compiete if it is r.e. and any r.e. set is m-reducible to it. 

From theorem 1.6 we have immediately: 



3.2. Theorem 

{at K is m-compiete. 

It is possible to have a notion of in -complete sets for classes other than the class of 
r.e. sets; it is then nccessafy |0 Keep the reference to r.e. here. 
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lb) A is m-complete iff A = m K iff A is r.e. and K ^„ A, 
(c) Olr. consists exactly of alt m-complete sets. 

Applying this we have the following: 

3.3. Examples 

The following sets are m-complete. 

(a) {xice XV.) (example \.2(\b)), 

lb) any non-trivial r.e. set of the form {x : & x e &} where S3 = ^ x 

(the proofs of theorems 7-3.4 and 3.8 show that K s^such a set), 

ic) [x:4rC*)-€jJ 

id) [x-xeEJ 



Excreise 1.7(1). 



The reader may have realised that m -reducibility appeared implicitly in 
the statement of theorem 7-3.2. which implies immediately that 

3.4. Theorem 

Any m-complete set ts creative. 
Proof If A is m-complete, then K <™M. so K s m .4, and by Theorem 
7-3.2 A is productive. D 

It is very pleasing to find thai Ihe converse of this theorem is also true, 
giving us a precise characterisation of m-complete sets: 

3.5. Theorem (Myhill) 
Creative sets are m-complete. 

We must wait until chapter 11 for a new tool -the Second Recursion 
theorem - with which to prove this result. Note, however, that we have 
already established it for creative sets of indices in example 3.3(6). 

As an immediate corollary to theorem 3.4 we can use simple sets to 
show that Om and 0* are not the only r.e. degrees: 



3.6. Corollary (to theorem 3.4) 

Simple sets are not m-complete \ hence if a is the m-degree of any 
simple set, then m <„ a < m m . 

Proof. Simple sets are designed to be neither recursive nor 
creative. C 

This corollary justifies the inclusion of something between 0^ and 0' m in 
fig. 9a; it does not, however, justify the suggestion in that picture that 
there is more than one non-recursive r.e. m-degree other than On In fact 
there are infinitely many such m -degrees, although we shall not prove this 
here. 
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It is beyond the scope of this book to investigate further the structure of 
the m-degrces under their partial ordering s„,, which, as already 
mentioned, is very complex. Much of this complexity can be deduced 
from results about the complex nature of the Turing degrees, which we 
discuss in the next sections. 

4. Relative com put ability 

We saw in § 1 that m-reducibility has two rather unsatisfactory- 
features: the exceptional behaviour of and M, and the fact that we do 
not always have A s m A. These features stem from the restricted nature 
of m-reducibility: we have 4< m B only if each question *x€ AT can be 
settled by answering a single prescribed question about B in a prescribed 
way. The idea of Turing reducibility, which we shall define in § 5, is that 
'xeAV t;an be settled in a mechanical way by answering several ques- 
tions about B, the nature and (finite) number of which are not necessarily 
known in advance. This idea is made precise in terms of relative compu- 
tability, which we describe in this section. 

Suppose that x is any total unary function. Informally we say that a 
function /' is computable relative to x, or just x-computable, if / can be 
computed by an algorithm that is effective in the usual sense, except that 
from time to time during computations we are allowed access to values of 
the function x- Such an algorithm is called a x-^oritnm. We can think of 
a ^-algorithm as being linked to some external agent or oracle that can 
supply values of x on demand. The ^-algorithm operates in a purely 
mechanical fashion, and a value xfyt ) is requested from the oracle only as 
dictated by the algorithm. 

We can formulate a precise definition of relative computability using a 
modification of our URM, called an Unlimited Register Machine with 
Oracle, or URMO for short. 



4.1. Definition 

The URMO is like the URM in all respects except that it can 
recognize a fifth kind of instruction 0(h ) for every n> \. The instruction 
0(n) is called an oracle instruction. 

To be able to obey oracle instructions the URMO must be linked to an 
oracle, which supplies values of some given function x on demand. We say 
then that the URMO has the function x in its oracle. The function v is riot 
thought of as part of the URMO itself. 

The response of the URMO to an oracle instruction Oin ) is as follows: 
if x is in the oracle, then replace r„ (the contents of register R„ 1 by £(*•„>. 
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This is denoted in flow diagrams by 

The URMO, with x in its oracle and obeying the instruction Oin ) may 
be envisaged as shown in fig. 9b. 

A program is, as before, a finite sequence of instructions. The URMO 
operates under a URMO program P in the same way as the URM, with 
the following additional stipulation: after obeying an oracle instruction l* 
m P the next instruction is 7 K _ : . 

We emphasise that in a URMO program P no particular function x > s 
mentioned. Thus the meaning of P varies according to the function 
supplied in the oracle. However, a computation under P can be carried 
out only when a particular function x is supplied, so we write P* to denote 
the program P when used with the function x m Inc oracle. Thus we write 

for the computation by P, with x in the oracle, and with initial configura- 
tion at, a%, . . ., a m 0,0, . . . ; and wc write 

P*(a)lb 
lo mean that the computation P'ia) slops with the number b in register 
Ri. 

We can now make the following definitions (parallel with definition 
1-3. IV 



Fig. 9t>. 



«i "i R? 

Wuh resulting configuration 



Ora-I: 
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4.2. Definition 

Let * be a unary total function, and suppose that / is a partial 
function from V to N. 

(a) Let P be a URMO program. Then P URXfO-computes f 
relative to x (or f is x-computed by P) if, for every a 6 N" and 
ielM, 

P*(«}j£ if! /(a)^A. 

(£0 The function / is URMO-computablc relative to x (or just 
X-computable) if there is a URMO program that URMO- 
computes it relative to x- 

We write %" to denote the class of all ^--computable functions. 

We are now in a position where wc could define Turing-reducibility. 
However, to aid a better understanding of this concept when we come to 
it, we shall first outline a little of the development of the theory of relative 
computability. 

Most methods and results from unrelativised computability have 
counterparts in relative computability. Thus in many of the theorems that 
follow we supply only a sketch proof or a reference to the unrelativised 
version of the same result. Throughout this section x «ands for a total 
unary function. 



4.3. Theorem 

ib) v-cv; 

(c) ifx is computable, then <€ = <fc* 

(.</} ¥* is dosed under substitution, recursion and minimatisation. 

le) if tb is a total unary function that is x-compuiabie, th 



en 



Proof. 



(a) Use the URMO program 0(1). 

(b) Any URM program is a URMO program. 

(c) fa view of (K we need only show that ■£* £ *. Suppose that / 
is ^-computable and that x is computable. Proceeding 
informally, we can compute any value of / as follows: use the 
^-algorithm for/, and whenever a value of x is requested simply 
compute it using the algorithm for x- This is an effective pro- 
cedure, so by Church's thesis / is computable. (We leave the 
reader to provide a formal proof of this result; see exercise 
4.10(3.).) 
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Id) The proofs are identical to ihose of theorem* 2-3.1, 2-4.4 
and 2-5.2. 

[e } The proof is similar ro that for (c) (which is really a special 
case of i.e)). U 

Other approaches to relativised computabllily Any alternative 
approach to compu lability can be modified lo provide a corresponding 
notion of relative computabiliiy. A relativised version of the Fundamen- 
tal result (theorem 3-1.1} can then be proved, and this leads to the 
formulation of Church's thesis for relativised compu (ability. 

We mention here only the relativised notion of partial recursive 
function: 



4.4. Definition 

The class $* of \-pamal recursive functions is the smallest class 
of functions such that 

(fl) the basic functions are in 3?*, 

ib) #€»*, 

(c) #* is closed under substitution, recursion and minimalisa- 

tion. 
The phrases partial recursive in x or partial recursive relative to \ are 
also used with the same meaning as .v-partiat recursive. 

The notions x- r ccursive lor recursive in, or relative to. x) and ^-primi.'/w 
recursive lor primitive recursive in, or relative to, x) are denned in the 
obvious way. 

Corresponding to theorem 3-2.2 land proved ui the same way) we have 

4.5, Theorem 

For any x,® * = <€*. 

.\umbering program:- and functions URMO programs can be 
effectively numbered or coded by an easy adaptation of the method used 
in chapter 4 for URM programs. Let us assume thatthis has been done, so 
that we have a fixed effective enumeration i.without repetitions) 

of all URMO programs.' Then we write 

#,";" for the n-ary function ^-computed by Q m , 

Each URM program P appears in this liSv i in most cases, however, its number 
here will he different from thai assigned to it in ehaptcr 4. 
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&»■. for**;', 

W%, for Domini,), 

E^forRanl^). 

The s-m-n theorem (4-4.3 > has a relativised counterpart with identical 
proof: 

4.6. Theorem (The relativised s-m-n theorem) 

For each m. n ^ 1 there is a total computable (m — l)-ary function 
s"tV, x< such that for any x 

S'ote. The function s'» here differs, of course, from the function given the 
same name in theorem 4-4.3. Note, however, that i" here is still 
computable (not merely ^-computable! and does not depend on .*. 

Universal programs for relative computability Relativisation of the 
proof of theorem 5-1.2 gives immediately: 

4.7. Theorem 

For each n, the universal function tl'u n for n-ary x-c"nputab!e 
functions given by 

is x "Computable. 

Remark, A careful examination of the full formal proof of theorem 5-1 .2 
would show that there is a URMO program CV. independent of x, thai 
^-computes ^\f for any x- 

X'ftcursite and **r.e\ sets The relativised notions of recursive and r.e. 
sets are given by: 



4.8. Definition 

I et A be a set 

(a) A is X'fvcursiw (or recursive in x> "I" Ca is .v-computable. 

(t») A is*-r.«r. Cor r.e. in x) if the partial characteristic function 

1 HxaA. 



f(x) n * X sa, 

(undefined if x£ A, 



^-computable. 
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The followingselection of basic results about ^-recursive and .v-r.e. sets 
is proved by the addition of the prefix *- at the appropriate places in the 
proofs of the corresponding unrelativised results in chapter 7: 

4.9. Theorem 

(a J For any set A, A is ^-recursive iff A and A are *--r.e. 

ib ) For any sel A, the following are equivalent 

(i) A is x-re-, 

(.ii) A = W%, for some m. 

(iii) A = E„ for some m, 

(iv) A = or A ts the range of a total ^-computable function, 

(v) for some x-decidable predicate R U, y), 

x€A O 3y Rix.y) 

iR is x-decidable ii its characteristic function is ^--computable). 
(c) Let K x ={x:x€ W*\; then K" is y-r.e". but not x-recursive. 



ComputablHiy relative to a set For any set A, we define compmability 
relative to A (or just A-computabtlity ) to mean computabilily relative to 
c A , the characteristic function of A. Thus we write 

P A for P* A (if P is a L'RMO program). 

« A for <€ c \ 

*fife*ft, 

WC for K*f, 

fii.to®, 

^-recursive for c^- re cursive, 

.A -r.e. forc^-r.e., 

etc. 

In the next section we shall define Turing reducibility in terms of 
computability relative to a set. For a set A, we can summarise the basic 
idea that we have presented in this section, in a nutshell, as follows: 
A -computability is computability for anyone who knows all about A. To 
be a little more precise, we should expand this to: for anyone who can 
answer any question of the form \i eAV. This excludes knowledge of 
'infinite' facts about A, such as whether A has infinitely many even 
members. 
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4.10. Exercises 

1. Let X'tif be total unary functions, and suppose thai <t>l is total. Is 
&t necessarily total? 

2. Suppose that XuXto •--.#* are total unary functions. Define 
38 "*s ' to be the smallest class of functions containing the 

basic functions and xi **. and closed under substitutions. 

recursion and minimahsation. Formulate a definition of the set 
<#"i - ■■*. f f unc ti ons computable relative to Xu ,..,#* such that 

<£"'•■■*' = &*' **. (Hint. Either define a machine having * 

oracles, or find a single unarv function \ such that 3l y *■ -= 

at*.) 

3. Provide a full formal proof of theorem 4.3(c): if x is compu- 
table, then % = <€*. 

4. Show that there is a total computable function k (independent of 
Xi such that Wlw = W$ u W% for all indices a, b. 

5. Verify theorem 4.9. 
fi. Let A be any set. 

la) Show that for any r.e. set B. there is an index e such that 

lb) Show that if A is recursive , then W* h r.e. for all e. 

(c) Show that If A is recursive, then K A is r.e. but not 

recursive. 

?. Let A, B, C, be sets. Prove thai 

(<r) if A is ^-recursive and B is C-recursive, then A is C- 

recursive, 

(h) if A is i?-r.e. and B is C-reeursive, then A h C'-r.e., 

ic) if A is fl-rccursive and B is C-r.e., then A is not necessarily 

C-r.e. 

8. (Relativisation of theorem 1.6.1 Let A be any set. Show that for 
any set B, 

BisA-r.e. oB£ m A"\ 

9. Show that there is a single number a such that 

AT A = W^forallsetsA. 

10. (a) We say that a set A is x-simplc if (i) A is *-r.e., (ii) A is 
infinite, (iii) A contains no infinite j^r.e, subset. Show that there 
is a ^-simple set. 

lb) Formulate the definition of a ^-creative set. Show that a 
X-simplc set is not ^-creative. 
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Turing reducibility »nd Turing degrees 

Using relative comp usability we make the following definitions: 



5.1. Definitions 

(a) The set A is Turing reducible lor just T-reducible) to the set 
B if A is B-recursive (equivalently, if c,\ is B-computab!e ). This is 

written A 5 T B. 

ib) The sets A, B are Turing equivalent (or T-equivalent) if 

A ^rB and B £ T A. (The use of the word equivalent is justified 

in theorem 5.2(A) below.! We write this A =tB. 

Let us consider informally the meaning of Turing reducibility. Suppose 
that A ^tB and that P is a URMO program that computes c A relative to 
B. Then for any x. P H {x) converges and 

P H ix)ii ifxzA, 

P B {x)iO \fx£A. 
During any completed computation P a (x) there will have been a finite 
number of requests to the oracle for a value c B {n ) of c e , as dictated by P 
and the progress of the computation. These requests amount to a finite 
number of questions of the form 'n eB?'. So for any x, 'x =AT is settled 
in a mechanical way by answering a finite number of questions about 
B. Thus we sec that Turing reducibility accords with the informal notion 
of reducibility discussed at the beginning of § 4. 

Some of the basic properties of the relations ^t find =i are given in the 
next theorem. 



5.2. 



Prooi 



Theorem 

{a) ^t 15 reflexive and transitive, 

ib) — t is an equivalence relation, 

(c) ifA^„BthenA^ T B, 

id] A= r AforallA, 

ie) if A is recursive, then A £ T B for all B. 

(/) if A is recursive and B s T .4 then B is recursive, 

ig) if A is r.e. then A < T K. 

(a) and (&! follow immediately from the observation that 

A * T B ofc/ (by theorem 4.3(a), f») 

and hence 

A = t B &'4 A = <€ H . 
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(e) Suppose that fA^^B, and let P be a URM program in 
standard form that computes /. Then the URMO program 
P, Oil) is easily seen to B-compute c A . 

id) Since c A =5g n c J t, .4 is A -recursive 'by substitution); hence 
A s TJ 4: and A ^rA similarly. 
tc) By theorem 4. 2yh). 

(f) By theorem 4.3(c). 

ig) By \fi) above and theorem 1.6. C 

Remarks 

1. From Id), ie), if\ of this theorem we see that T-reducibility does not 
have the defects of m-reducibility; this also shows us that these two 
notions are distinct. 

2. Part ig) of the above theorem shows that K is a T-complete (r.e.) set, 
according to the following definition: 

5.3. Definition 

A set A is T-complete if A is r.e. and B -£ T A for every r.e. set B. 

The name Turing degree is given to any equivalence class of sets under 
the relation =t: again, we think of a degree as a collection of sets all 
having the same degree of difficulty. 



5.4. Definitions 

(a) Let A be a set; the equivalence class 

dT<A) = {B:B= T A} 

is called the Turing degree of A, abbreviated the T-degree of A. 

\b ) Any T-degree containing a recursive set is called a recursive 

T-degree. 

ic) Any T -degree containing an r.e. set is called anr.tf. T-degree. 

The notions of Turing reducibility and Turing degree are widely 
accepted as the most basic among all other similar notions. Hence the 
term reducible without qualification is often used to mean Turing 
reducible, similarly, Turing degrees are often referred to merely as 
degrees, or degrees of unsolvabHity. We shall adopt this practice in the 
remainder of our chapter. As before, the letters a, b. c, etc. arc used for 
degrees. 

The relation ^t on sets induces a partial ordering on degrees, as 
with <„,: 
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5.5- Definition 

Let a, b be degrees. 

(a) a *s b if for some (equivalently, for all) Afa and Beb, 

lb) a <b if a^-b and a ?* 6. 
(We leave it as an easy exercise for the reader to verify that < is a partial 
ordering on degrees {cf. theorem 2.6).) 



We can reformulate much of theorem 5.2 in terms of degrees as 
follows: 



5.6. Theorem 

(fll There is a single recursive degree, which is denoted 0; 
consists of all the recursive sets, and is the unique minimum degree. 

(b) Lei 0' denote the degree of K; then 0<0' and 0' is a 
maximum among allt.e. degrees. 

(c) For any sets A, B 
(i) (UAistMA), 

(ii) // d„{A)<„,dJB), then d T [A) < d T (B). 
Proof 

{a) This is immediate from theorem 5.2(e) and if). 

ib) From (a) 0^0'; and 0*0" since K is not recursive. By 

theorem 5.2(g), if a is any r.e. degree, a ^0'. 

(c) Immediate from theorem 5. 2!c). ZZ 

There are two fundamental features of the structure of Turing degrees 
under their partial ordering that we should now mention. 

The jump operation We have seen that the step from recursive sets to 
T-complcte sets such as AT is a definite increase m degree of difficulty, 
expressed in the language of T-degrees by writing < 0'. We now show 
that for any degree a there is a corresponding step or jump to a higher 
degree a', known as the jump of a. This is defined using the set 
K A = {x:x€ W A \ (for any set A€a): but first we need the following 
theorem. 

5.7. Theorem 

Let A, B be any sets. 
(a) (i) K A isA-r.e„ 

(ii) ifBisA-r.e.,thenB* T K A . 
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ib) If A is recursive then K = t K. 

(c) A< V K*. 

(d) (i) IfA* T BthenK A < T K", 
(ii) if A « T 6 thenK A ~ T K*. 



Proof. 



(a) (i) is given by theorem 4.9(c); for (ii), a straightforward 
rclativisation of theorem 1.6 (using the relativised s-m-n 
theorem) shows that if B is A-t.e. then B * m K A . 
lb} Clearly K s T K*. since K is A-r.e. for any A; on the other 
hand, if A is recursive then the -4-computable partial charac- 
teristic function of K A is actually computable (theorem 4.3(c)): 
hence K A is r.e. Thus K A s T K. 

(c) A ^tK a is given by laMii); A ^ t K A is given by theorem 
4.9(c). 

{d) (i) If A * T B, then since K A is A-r.e. it is also fl-r.e. (see 
exercise 4.10(7*)). Hence K A ^jK a by (a){ii). 
(H) follows immediately from (i). D 



Part (a) of this theorem tells us that K A is what we would call a 
T-compiete A-t.e. set; il is sometimes called the completion of A, bui 
usually it is called the jump of A and denoted A'. 

Notice that for any A e 0, the degree of K A is 0' (by \b) of the above 
theorem). This leads lo the following definition of the jump operator on 
degrees. 

5.8. Definition 

For any degree a, the jump of a, denoted a', is the degree of K A 
for any A € a. 



Remarks 

1. Theorem 5.7(d) tells us that this is a valid definition because the 
degree of K A is the same for every A € a. 

2. By theorem 5. lib) the new definition of 0' here as the jump of 
accords with our earlier definition of 0' as the degree of K (theorem 5.6). 



We can immediately write down the basic properties of the jump 
operator: 



5.9. Theorem 

For any degrees a, b 
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Proof. 



in) a<a', 

f>) if asfrihena'<6\ 

(c) 0'<a', 

(<*> if flsft. Aea and B is -4 -r.e., then A < a'. 

(a) By theorem 5.7(c). 
lb) By theorem 5 "(d). 
{c) From (6), since 0^ a. 
{d) By theorem 5.7(a). G 



The second fundamental feature of the structure of the Turing degrees 
is one wc have seen already for the m-degrees: they form an upper 
semi -lattice: 

5.10. Theorem 

Any degrees a, b have a unique least upper bound. 
Proof. We merely mention that the least upper hound of a, b is (as with 
m-degrees) the degree of AQB for any sets A s a, 8 = b, and leave the 
rest of the proof as an exercise, which is similar to the proof of theorem 
2.8. 3 

The least upper bound of degrees a, b is denoted by a ^ b : it is clear 
from the construction that if a, b arc r.e. then so is a v b. 

The structure of the Turing degrees under their partial ordering, and 
equipped with the operations ' and ^. has been studied extensively, and is 
still by no means fully understood. Particular attention has been given to 
the structure of the r.e. degrees (these do not form an initial segment of 
the Turing degrees, as was the case with the r.e. m-degrees: see theorem 
5.18 below). It is now known that the structure of the T-degrees and the 
r.e. T-degrees is extremely rich and complex. For a long time, however, 
even the following simply posed question was unsettled: 

5.11. Post 's problem 

Is there an r.e. degree a such that < a < 0".' 

This problem was posed by Post in 1944. The simple sets, invented by- 
Post, did not provide an answer, as they did with corresponding question 
for m-degrees (corollary 3.6). One reason for this is seen in the following 
result of Deleter, which shows in particular that 0' contains a simple set. 
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5.12. Theorem 

Any non-recursive r.e. degree contains a simple set. 
Proof {sketch). Let B be an r.e. set that is not recursive, and let 
B = Rani/1 where / is a total injective computable function (exercise 
7-2.18(7)}. Let A be the set given by 

A ={x:lyiy>x and /(>)</<*))}. 

In exercise 7-4.4(2) we gave the hint for showing that A is simple. We 
leave the proof that A = r B as an exercise (exercise 5.21(6) below). 3 

This theorem underlines the difference between m-degrees and T- 
degrces, since it shows that 0'. unlike 0™. contains many r.e. sets that are 
not m -complete. 

The breakthrough on Post's problem came in 1956 when Friedberg 

and Muchnik independently proved: 

5.13. Theorem 

There are r.e. sets A, B such that A£ r B and B £ T A. Hence, if 
a. b are d T \A ), d-rlB ) respectively, a£b andb£ a, and thus < a < 0' and 
0<b<0'. 



(Degrees a. b such that a&b and b£a are called incomparable 
degrees; this is written a I A.) 

For a proof of the Friedberg-Muchnik theorem, which is well beyond 
the scope of this book, we refer the reader to books such as Rogers L 1 967] 
or Shoenfield [1971]. Friedberg and Muchnik used a new technique 
known as the priority method, which opened the way to the discovery of 
the complex nature of the structure of the Turing-degrees. 

There are many results about degrees that, like the Friedberg-Much- 
nik theorem, are easy to formulate but difficult to prove. We give below a 
sample of these, to illustrate the complexity of the T-degrees. 

5.14. Theorem 

For any r.e. degree a >0. there is an r.e. degree b such that b a. 

5.15. Sacks' Density theorem 

For any r.e. degrees a < b there is an r.e. degree c with a<c<b. 

5. 1 6. Sacks' Splitting theorem 

For any r.e. degree a>0 there are r.e. degrees b.c such that 
b<a*c<a and a = bvc (hence b\c). 
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5.17. Theorem (Lachlan, Yales) 

(a ) There are r.e. degrees a.b>0 such thai is the greatest lower 

bound of a and b. 

(b) There are r.e. degrees a, b having no greatest lower bound 
{either among ail degrees or among r.e. degrees ). 

Turning to non r.e. degrees, a surprising result is 

5. IS Theorem (Shoenfield) 

There is a non-r.e. degree a < 0'. 

A minimal degree is a degree m>0 such that there is no degree a with 
0<fl<m. By Sacks' Density theorem there can be no minimal r.e. 
degree. However, Spector proved: 

5.19. Theorem 

There is a minimal degree. 

For proofs of these and other result* ahout degrees we refer the reader 
again to the books of Rogers and Shoenfield. The article by Simpson 
[1977 J gives a very readable survey of more recent results that are not 
included in these books. 

T-degrees and m-degrees Often results about T-degrees give informa- 
tion about the structure of the m-degrees almost immediately, via 
theorem 5.6(c). We illustrate with 



5.20. Corollary (to theorem 5.14) 

For any r.e. m-degreea > 0., there isan r.e. m-degree b such that 
b\a. 

Proof. Let Asa; A is r.e. so by theorem 5.14 take an r.e. T-degree c 
such that dr(A)|e. Let B be an r.e. set in c, and let b = 6 w (B). Then if 
a^ m b or b^ nt a, by theorem 5.6(f) we have iS T {A)^c or csd-riA), 
contradicting d T {A)|f. Hence a \b. D 

Other reducibilities There are other notions of reducibility that lie 
between the restricted notion of m-reducibility and the broader T- 
reducibility. The book of Rogers [19671 provides a full and detailed 
discussion of these. 
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5.21. Exercises 

1 . Show that each of the following sets is T-complctc: 
(a) {x: !€£,}, 

lb) [x:W t = 0). 

2. Improve theorem 5.7(4) by showing that A s T B iff 



A"** <„,£■*. and A 



' T BinK A = m K R . 



3. Show that the previous question can be made effective in the 
following sense: there is a total computable function / such that 
for any A, B, if c A = <*> f , then 6 tftl : K A * m K B . 

{Hint. Find total computable functions g, h such that (i) if 
c A = 4? then K A = H^.,,, (ii) $ m : W° < m K B , for all e.) 

4. For any set .4 define a sequence of sets A"" by 
A 9» mA . A ln ' , =K AU ". 

and let A' , " i = {vim,n):m€A r -'\. 

(a) Show thai A w < t A M for all n. 

(b) Show that there is a total computable function h such that 
c A «. =4>k£\ for all n. 

(c) Suppose that B is a set such that A'"'£ T B for all n in the 
following strong way: there is a total computable function / such 
that e A w=4/U all n. Show that A"" ^ T B. 

id) Show that if A< r B thenA ,n> ^ T H n, alln, and A ,y '< T S""- 
(Hint. Use question 3 above, together with ib) and (c ).) 

5. Prove theorem 5.10. 

6. Complete the proof of theorem 5.12. 

7. Prove as a corollary to theorem 5.17(a) that there arc r.e. 
m-degrecs such that m is the greatest lower bound of a and b. 



10 

Effective operations on partial 
functions 



Once we have studied effectively computable operations on numbers it is 
natural to ask whether there is a comparable notion for operations on 
functions. The essential difference between functions and numbers as 
basic objects is that functions are usually infinite rather than finite. With 
this in mind, in § 1 of this chapter we discuss the features we might 
reasonably expect of an effective operator on partial functions; this leads 
to the formulation of the definition of recursive operator* on partial 
functions. 

In § 2 we shall sec that there is a close connection between recursive 
operators and those effective operations on computable functions that we 
discussed in Chapter 5 § 3. In § 3 we prove the important fixed point 
theorem for recursive operators known as the first Recursion theorem. 
The final part of this chapter provides a discussion of some of the 
applications of this theorem in compmability and the theory of pro- 
gramming. 



1. Recursive operators 

Let us denote by S 5 , (.« s I ) the class of all partial functions from 
W' to H. We use the word operator to describe a function <P : & m -» & r . ; the 
letters #, #* , . . . will invariably denote operators in this chapter. We shall 
confine our attention to totally defined operators 0;^ m -*^\ i.e. such 
that the domain of d> is the whole of & m . 

The chief problem when trying to formulate the idea of a computable 
(or effective) operator <Pi &\ -* 9\, say, is that both an 'input' function f 
and the 'output' function #</! are likely to be infinite objects, and hence 
incapable of being given in a finite time. Yet our intuition about effective 
processes is that in some sense they should be completed within a finite 
time. 

To see how this problem can be overcome, consider the following 
operators from &i to &i'. 
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la) *![/) = 2/. 

(*.i <Pt(f) - c, where gix ) = I v .- a /t y). 
These operators are certainly down to earth and explicit. Intuitively we 
might regard them as effective operators: but why? Let /«=.^i and let 
gi — &(/}; notice that any particular value g|Y» (if defined) can be 
calculated in finite time from the single value f{x) of /; if we set 
fr 2 = & 2 {f\ then to calculate g 2 ix » (if defined) we need to know the finite 

number of values /(0),/tl) fix}. Thus in both cases any defined 

value of the output function ($i(/) or 4>;( /)) can be effectively calculated 
;n a finite lime using only a finite part of the input function /. Thi* is 
essentially the definition of a recursive operator given below. 

One consequence of the definition will be the following: suppose that 
<Pi,fHxi = y is calculated using only a finite part 6 of/; then if g is any 
other function having H as a finite part we must expect that &{g)[x) = y 
also. 

To frame our definition precisely there are some technical considera- 
tions. First, let us agree that by a 'finite pan' of a function /we mean a 
finite function extended by /. (We say that 8 is a finite function if its 
domain is a finite set.) For convenience we adopt the convention 

'J always denotes a finite function in this chapter. 

The above discussion shows that the definition of recursive operator 
will involve effective calculations with finite functions. We make this 
precise by coding each finite function $ by a number H and using ordinary 
computability. A suitable coding for our purposes is defined as follows: 

suppose that $ € £;. The n-tuple x = (j : x n ) is coded by the number 

to^pf'^p!** 1 . ..pi-"'; then define the code $ tor 6 by 

*" n Pw** 1 provided that Dom(ft) 7*0. 

= ifDora{*) = 

(in which case =fz). 

There is a simple effective procedure to decide for any number z whether 
2 = for some finite function 0; and if so, to decide whether a given * 
belongs to Doraltf). and calculate fl)>) if it does. 
Now we have our definition: 



1 . 1 . Definition 

Let &;&„,-* & n . Then <P is a recursive operator if there is a 
computable function <*U,x) such thai 'for all fe&„ and xslV, ye\ 
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*(*.*-)- 



*(/)(*)=*>• ilT there is finile ff£/ such thai ^■A.j\i-y. 
(Nolc lhat £ is not required to be total.) 

1 .2. Example 

The operator 0(f) — 2/ is a recursive operator: to see this define 

j 2r?(x ) if z = and * * Domlfl >. 

1 undefined otherwise. 

By Church 5 thesis, <b is computable: now for any /. x, y we have 

&{f)ix ) - >- & xs Dom(/) and y = 2/(x) 

<=> there is c f with *eDorn{#) and y = 2fli>! 

e* there is 0c f such lhat d>(6, xt = y. 
Hence is a recursive operator. 

Further examples will be given in 1.6 below. 

An important feature of recursive operators is that they are continuous 
and monotone in the following sense. 

1.3. Definition 

Let <P:SF m -*& r be an operator. 
{a) *t> is continuous if for any /£->,„. and all x. y: 
#(/)(*)=*? itf there is finite fle/wtth 0Uf){x\ = y\ 
[b ) is monotone if whenever /, g € 5% with / £ g. then 

These properties are easily established for recursive operators, and as 
we shall see they aid the recognition of such operators. 



1.4. Theorem 

A recursive operator is continuous and monotone. 

Proof. Let 0:& m -*3F„ be a recursive operator, with computable 
function <£ as required by the definition. Suppose that 0(f)ix) — y, and let 
S~f such that 4>y§, x! = y. Since t?Q0, it follows immediately that 
0{0)\x) =« y. Conversely, if $ c/and 0y6)[x) » y, there is 0) ^ ^ such that 
(6(0i, x» = y; but then &)=f, so we have that 0{f){x)=*y. Hence <£ is 
continuous. 

Monotonicity follows directly from continuity: suppose that /eg and 
0{f)ix)^y. Take 0c/ such that 0<$nx)~y, then = £. so by 
continuity, #(g)(.r) = y. D 
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The use of the term continuous to describe the property 1.3(a) is 
justified informally as follows. Suppose that #:^,-*;f, satisfies 1.3(a) 

and feJPi. Then given any ,t : , x* for which <£(/)(*,) (l£i £&) are 

defined, using 1.3(a) we can obtain a finite flc/ such thai <£(0»(x ; ) = 
#i;/)[i ; ) (l£i=sfc). Thus, whenever g20. by 1.3(a) again, we have 
*(* K**) = #(/)(*) (I sisjfc). i.e. if g is 'near' to / (in the sense that they 
agree on the finite set Dom(0») then 0(g) is 'near' to <P{f) (in the sense 
that they agree on the finite set Xt,....**). Thus, informally, is 
continuous. 

The continuity property 13(a) specifies that a value <P(f)(x) is deter- 
mined (if at all) by a finite amount of positive information about /, This 
means information asserting that / is defined at certain points and takes 
certain values there, as opposed to negative information that would 
indicate points where / is not defined. Using this idea the term continuous 
can be rigorously justified as follows. 

The positive information topology ' on & m is defined by taking as base of 
open neighbourhoods sets of the form 
U* = {/:#£ f] ($ € & mt finite). 

Thus / belongs to ££ iff is correct positive information about/. It is then 

an easy exercise to see thai an operator is continuous with respect lo the 

positive information topology precisely when it possesses property 
1.3(a). 

The following characterisation of recursive operators using continuity 
will make it easy to establish recursiveness of various operators. 

1.5, Theorem 

Let &:& m -*-p„be an operator. Then is a recursive operator iff 

(a) is continuous, 

tb) the function tft[z,x) given by 

U{$, x) - 0(0){x) for e & mr 
\<£>(z, x] is undefined for all other z, 
is computable. 

Proof. Suppose that * is recursive with computable function d> x such 
that 

*(/)fct) ^ y iff 30(0 c / and <*,(£ x) <- y). 



I'he reader unfamiliar with topology will lose nothing in further development by 
onmting this paragraph. 
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Then taking d> as given in the theorem, we have 

4>{ff 7 x) = y O 30i(0|C(?and<*M0i.*>^y); 

the relation on the right is partially decidable, so <t> is computable by 
theorem 6-6.13. 

Conversely, suppose that conditions (a) and {b\ of the theorem hold: 
then 

#(/>!*» a y«3«(flc/ and <Pidttx) - vl (by (a n 

•» 3#{« e/ and #(9, x)=*y) (by (*)), 

whence * is a recursive operator. D 

This theorem enables us to show quite easily that the following 
operators arc all recursive: 

1.6. Examples 

(a) (The diagonalisaiion operator) <Pif\{x)=*fix,x) {/ = F 2 ). 
<t> is obviously continuous, and tfrtO, x)~ >i{x ; x'< is computable. 

(b) 0{f)\x}*-Z v ~J(Y)lfe&J 

This is the second example discussed at the beginning of this 
section. We saw there that discontinuous; and clearly £i#, *)-= 
Iv-.i 9iy) >s computable, 

(c) l-et^e 9 t be computable. Define &\:? m -*& H by 0{f\= g a f. 
Obviously is continuous, and $y d, x)=*g{0(x)) is computable. 

(d) (The Ackermann operator). Let : 5^ -* 3r 2 oe given by 

#</>(".>) = > + 1. 

#(/)(* - 1 , y * 1 1 =/(x, /{* +1, y)J. 

To see that Q> is continuous, note that tf*(/)u, y) depends on at 
most two particular values of/. For recursiveness, it is immediate 
by Church's thesis that the function & given bv 

cM0*,o,y) = y + i 

cVftjn l,O) = 0(x, 1) 

4>K$, x + 1, y + 1)=* flu, fl(x - 1, y» 

is computable. 

(e) (The *x-operator.j Consider <£>: & n ,\-*&n, given by 
&if){x) — py(f[x,y) = 0). It is immediate that this operator is 
continuous, and that the function <*> given by 

is computable. 



When the definition 1.1 of a recursive operator <t>\. '?„-*. %. is extended 
;o the case n =1), we have what is called a recursive functional. The 
members of #!> are 0-ary functions; i.e. constants. Just as m (nil) 
includes the function that is defined nowhere. ?„ includes the "undefined' 
constant, which is denoted by o. Thus & a — ftiu{a>}, and an operator 
: &m. -* #i> is a recursive functional if there is a computable function <* U i 
such that for any fe .?,„ and y ^ 1^: 

We write #{/}=« if <P(/i is undefined; this emphasises that * is still 
thought of as being a total operator. 

Wc should point out that in some texts the term partial recursive 
functional 3% -* ,?„ is used to describe recursive operators, including the 
case n = 0. In such contexts the word partial describes the kind of object 
being operated on rather than the domain of definition of the operation. 

We shall not discuss here the extension of the ideas of this section to 
partially defined operators and the corresponding partial recursive opera- 
tors 0:.^ m -*^,. The reader is referred to Rogers [1967] for a full 
discussion of these and related matters. 

1.7. Exercises 

1. Show that the following operators are recursive. 
{a) 0if)-f 2 {f^^ 1 ) t 

ib) (Pif) = g (/€ iF„), where g is a fixed computable function in 

&u 

(<?) 0(f) — /'g ifc #i ) where g is a fixed computable function in 

Id) Let fceSV.i be a fixed computable function; define 
tf^-i-^-ihy 

iffcU,y) = 0, 

0<J){x, y) - fix +■ 1, >•) 1- 1 if h(x, y) is defined and ^0, 

undefined otherwise 

(The significance of this operator will be seen later.) 

2. Prove that if is a recursive operator and/is computable then so 
is #(/). 

3. Decide whether the following operators *:.f]-*;f| are (\) 
monotonic, (ii) continuous, (iii} recursive. 

M^WmJK"* 'fD-mi/lisfimte, 

(undefined if Domi f) is infinite. 
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fO if ft* I is defined, 

WW-Uw otherwisc . 



(c) 0{/)U) = 



wj #(/x»h 



if /(jt) is defined, 



1if/U)t=JC. 

undefined otherwise . 
[undefined if Domi/I is finite. 
\f(x) if Doml/) is infinite. 

4. Suppose that $;&„•*&* and &:&„-* & p are recursive opera- 
tors. Prove that ^ > d> : .f ,„ -* 3v is recursive. 

5. Show how to extend the definition of recursive operator to 
include operators *:^ B| x3F m ,x. . .Xp my -*.^, and prove 
appropriate versions of theorems 1.4 and 1.5 for your definition, 
Prove that the following operators arc recursive: 

(a) &\&\X& n -*&« given by #(/,g)=/°g (cf. question lc 

above) ; 

(ft) #;&+iX$w*-»$M<i-givenby 

U ifAU.y) = 0. 

<P(/. A }(x, y) =■ ■ /U + 1 , >') + 1 if A U. j) is defined and is not 0. 

undefined otherwise 

(cf. Id above). 

6. (For those who know some topology.) 

(a) Prove that an operator is continuous in the sense of 

definition 1.3(a) iff it is continuous in the positive information 

topology. 

{b) Prove that the following arc equivalent for V?^ (1 : 

(i) V is open in the positive information topology, 

(ii) /e V" iff 3B\8 c / and 8 s V). 

7. Lei d> : W m ■* #, and !P: & -* ^ n be continuous operators, prove 
that ty*<P:&m -#^p is continuous. 

8. Let £P(N) denote the class of all subsets of \\ formulate a 
definition of a recursive operator #:iP£M)-»3*(i\) thal parallels 
the notion of a recursive operator from &\-*&\. Frame and 
prove theorems corresponding to theorems 1.4 and 1.5. 
{Hint. The question of membership xe<P(A) should depend 
ef!cetively on a finite amount of positive information about 
membership of the set A.) 

(Effective operators 5*(^) -*•#*(&> are called enumeration 
operators and arc discussed in full in Rogers [19671.1 
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2. Effective operations on computable Junctions 

In chapter 5 § 3 we considered that certain operations on 
computable functionsshould be called effective because they can be given 
by total computable functions acting on indices. For instance, in example 
5-3.1(2] we saw thai there is a total computable function g such that for 

We shall see in this section that any recursive operator <£, when 
restricted to computable functions, yields an effective operation of this 
kind on indices. This is the first part of a theorem of Myhill and 
Shepherdson. They proved, moreover, that all such operations on indices 
of computable functions arise in this way. 

We shall prove the two parts of the Myhill-Shcphcrdson result 
separately, taking the easier part first. 



2.1. Theorem (Myhill-Shcpherdson. part I) 

Suppose that V: S 5 ^ -*&„ is a recursive operator. Then there is a 
rota! computable function h such that 

#l*S" )-<i>C U?eN). 

Proof. Let w be a computable function showing that •/' is a recursive 
operator according to definition 1.1. Then for any e we have 

V\<l>?')ix)^y » 381$ = $? and^(£x) = y). 

We shall show that the function £ defined by 

is computable, by showing that the relation g{e, x) -* y is partially deci- 
dable. To this end, consider the relation R\z, e, x, y) given by 

R\z. e. x, y) = 30(r = 8 and ft <= $T' and #{§, x) =» y). 

Then J? is partially decidable, with the following informal partial decision 
procedure. 

(1) Decide whether z = $ for some 8 ; if so obtain X; x-,€ 

&"' and >'i, . . . , y k such that Dom{0j = (*i, . . . , Xk) and 8[Xi) = y, 
(lsisjk); then 

(2) for i = 1 k compute ^T'U); 'f. for ItBf&k, ^"''W is 

defined and equals v„ then 

(3) compute *f'(z,x) and if defined check whether it equals y. 
If R (z, e, x, y ) holds, this is a mechanical procedure that will tell us so in 

finite time, as required. 
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Since R{z,e.x,y) is partially decidable, so is the relation 
3zR(z, e,x, y) (by theorem 6-6.5): but 

3z Riz, e, x, yj o •t^fH*) ""J (from the definition of /?5 

O g(£, *) — y (from the definition of g). 

Thus gk. x] -- y is partially decidable, so by theorem 6-6.13 g is comput- 
able. 
Now the s-m-n theorem provides a total computable function h such 

Ihat ><*> r » s , 
4>h- t >',X)^gU\x} 

-'Vid> t m) Hx>. 

from which we have ££&, - *<*?"'). H 

Notice that the function /i given by this theorem for a recursive 
operator &; .^i -* ^j is extensiortai in the following sense. 

2.2. Definition 

A total function A : ^ -* FiJ is extensiona! if for all d, ft, if <£* = <b e 
then 0* la ) = «^i,: l s. 

Now we can state the other half of Myhill and Shepherdson's result. 

2.3. Theorem (Myhill-Shcpherdson. part II] 

Suppose that h is an extensionai total computable function. Then 
there is a unique recursive operator W such that W(<*> r ) = 6ht*< for all e. 

P'oof, At the heart of our proof lies an application of the Rice-Shapiro 
theorem itheorem 7-2.16). 

Lei h be an extensionai total computable function. Then h defines an 
operator f .-,: % -* <£-, by 

tf'o is well defined since h is extensionai. We have to show that there is a 
unique recursive operator 'P": ,r>. -* &\ that extends ¥/„. 

First note that VV0! is defined for all finite H, since finite functions arc 
computable. Thus any recursive operator V' extending lPn, being 
continuous, must be defined by 

(2.4) #C#U}-y = 3/?(^c/and ^„{0)(x}--yl 

So such a W, if it exists, is unique. To prove the theorem we must now 
show that 

(i) (2.4; does define an operator !f, 

(ii) V extends &», 
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(iii) IP is recursive. 
We first use the Rice-Shapiro theorem to show that ¥ is continuous in 
the following sense: for computable functions / 

12.5) #fcE/K*)aij » 3V(9s/and f c t$)( x )~y). 
To see this, fix x, y and let ^ = {f^'€ l ; t P^fi{x) = y}. Then the set 
A = {e: <f, Z sf) = {e:$ k(r \x)-y) is r.e.; so bv the Rice-Shapiro theorem, 
if / is computable then 

f€tf o 3fr.;0c/and fls.rf). 
which is precisely (2.5). 

Now we establish (i), (ii), (iii) above. 

(i) Lei f be any partial function; we must show that for any x, (2.4) 
defines V(/H*) uniquely (if at all). Suppose then that ir 2 £f and 
y.,(fl,)U) = y, and W(x)*.v 2 . Take a finite function fl a $„ 2 (say, 
9 =f\ Dom[0i) ^ Dom(0 2 )h by (2.5.) 

Thus (2.4) defines an operator V unambiguously. 

(ii) This is immediate from (2.5) and the definition (2.4). 

(iii) We show that tf' satisfies the conditions of theorem 1.5. Clearly ty 
is continuous, from the definition. For the other condition we must show- 
that the function & given by 

f\0,x)^tieHx), 

$iz t x} is undefined if z * 0, 

is computable. Now it is easily seen by using Church's thesis that there is a 
computable function c such that for any finite function 0. c[0) is an index 
for ff;Le-5*&,fc. Thus 

so i> is computable, since h and c are. Hence V is a recursive 
operator. D 



Remarks 

1. The proof of theorem 2.3 actually shows that for any extensionai 
computable h there is a unique continuous operator V: 9 y -* 5». such that 
V(^ ( .) = ^^ (e: „ all e, and that this operator is recursive. 
2^ Theorem 2.3 extends in a natural way to cover operators from 
&m -* 9*. The proof is almost identical, using the natural extension of the 
Rice-Shapiro theorem to subsets of <¥„ ; see exercise 2.6(2) below. 
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,6. Exercises 

1. Suppose thai <P, 9 are recursive operators &\-*&\\ knowing 
that * ^ is continuous (exercise 1.7(7 1) use the two parts of the 
Myhill-Shepherdson theorem together with the first remark 
above to show that 4»° ty is recursive. 

2. State and prove a general version of theorem 2.3 for operators 

from 3f„ - % n . 

3. Formulate and prove versions of the Myhill-Shepherdson 
theorem (both parts) appropriate for the operators you have 
defined (o) in exercise 1.7(5), (b) in exercise 1.7(8). 



3. The first Recursion theorem 

The first Recursion theorem of Klcene is a fixed point theorem 
for recursive operators, and is often referred to as the Fixed point 
theorem (of recursion theory). We shall see later that it is a very useful 

result 



3.1 . The first Recursion theorem (Klcene! 

Suppose that $: * m -*■ Sf m is a recursive operator. Then there is a 

computable function U that « &* Iea " f* xed P° inl °f * ; '-'■ 
ta) 01 U) = ,'V. 
(p) if&(g)=*g t tkenf*cg. 

Hence, iff* is total, it is the only fixed point of 0. 

Proof We use the continuity and monotonicity of to construct the 
least fixed point /♦ as follows. Define a sequence of functions {/„} in € N> 

by 

/o = fa (the function with empty domain i. 

Then U = fc = fu and if £,£&+* by monotonicity we have that /*+!» 
0i!\) = 0(f^ l )=f H .i. Hence /„ g/ B - ; for all n. Now let 

by which we mean 

/*(*)«} iff 3«suchthat/ r l*)=-y. 

We shall show that /«. is a fixed point for 0. 
For all n, 

fn S/* 
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hence 



thus 



/„-, «*(/,)£*</♦); 



Conversely, suppose that $(/*)(x)=*y; then there is finite 8c/ tf such 
that 0{e)(x)^y: taken such that $sf m ; then by continuity 0{f n Mx) = y, 
That is, &*j(*] = >. Hence /*(*» = y. Thus *(/*) cf , and so 0[U) = U 
as required. 

To see that /» is the least fixed point of 0, suppose that 0{g) = g; then 
clearly /o=/;-cg, and by induction we see that /„ sg for all n. Hence 
/* £ g, as required. Moreover, if /* is total, then /* = g, so U is the only 
fixed point of 0. 

Finally we show that /# is computable. Use theorem 2.1 to obtain a 
total computable function h such that for all e 

Let e 3 be an index for f Q ; define a computable function k by 

klO) = e a 

k{n + l)=h\Mn\l 
Then /„ = #*.„; for each n ; thus 

f*(x)-*y ** 3n<<0 fc( ,,lj) = y). 
The relation on the right hand side is partially decidable, and hence /* is 
computable. G 

Remark. The recursiveness of the operator was used in this proof only 
in showing that /# is computable. The first part of the proof shows that 
any continuous operator has a least fixed point. 

We shall see in the following examples that a recursive operator may 
have many fixed points, and that the least fixed point is not necessarily a 
total function. 



3.2. Examples 

1. Let be the recursive operator given by 

0{f)iO)=u 

#(/Xx + l)=/(.t + 2). 

Then the least fixed point is K* (0> " [* 

1/#U * 1) = undefined. 

Other fixed points of lake the form f ' ! °' = l| 

[fix 4- 1 » = a. 
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2. Recall the definition of the Ackermann function i£ in example 

2-5.5: 

<MO,y) = y + l, 

£(* + 1, y + \) = ${x, ip(x + 1, y)). 

The first Recursion theorem gives a neat proof that these equa- 
tions do define a unique function tf and that u> is total and 
computable. I -ct be the Ackermann operator given m example 
1.6(rfl. The fixed points of <P are the functions that satisfy the 
above equations. Let i/r — fa; then iji is a computable function 
satisfying these equations, so we have only to show that ^ is total. 
Clearly, MO, y) is defined for all >• ; if ijt(x, y) is defined for all y, 
then by induction on y we see that il/(x - 1, y) is defined for all y. 
Hence ti/{x, y) is defined for all x, y; i.e. e> is total. 

3. Let hyx,y) be a fixed computable function and let 4> be the 
recursive operator given in exercises 1.7(1*/). Then the least 
fixed point /» is a computable function satisfying 

[U ith\x,y) = O t 

/*{*, yl- j Uix 4-1, y)+l if h(x, y ] is defined and not 0, 
(undefined otherwise. 

But what is this rather strange looking function? We can quite 
easily cheek that 

UU,y) = n2{h[x~z,y) = 0) 

as follows. First suppose that ^izikix + z,y\ — t)) = m; then 
h(x 4-2, y) is defined and not for all z<m, and h(x + m, y] = 0. 
Hence 

/*<x.>*) = /*U + l,y)- 1 =.. . = fa{x + z,y) + z (z&m) 
= f&{x — m, y) + m ~0+ m — m. 

Suppose on the other hand that /*(*,y)<=m; then from the 
equations this must be because 

m = U(x, y) = U(x + 1, y) + \ = . . . = /*u + m, y)~m 

and h (x + z, y) is defined and not for z < mixhenf&tx +m,y ) = 

0, so h [x + m, y) = 0. Thus m = y.z*Mx + z.y) = 0>. 

We can infer from this example that the function /*(0, /)•=* 
ixz{h\z, y) = 0) is computable; of course, there is no use pretending that 
we have a new and clever proof of the closure of ^ under the /i-operator. 
since we have used this property of sf implicitly in our proof of the first 
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Recursion theorem. (In Kleene's equation calculus approach (see chapter 
3 51), however, the first Recursion theorem is proved without the use of 
the /^-operator, so closure under the ^-operator is established by this 
example.) 

We can see from the above examples why the first Recursion theorem is 
so called. The general idea of recursion is that of defining a function 'in 
terms of itself A simple instance of this is primitive recursion, discussed 
in chapter 2. We have seen more general forms of recursion in the 
definitions of Ackerman's function, and the function fa in example 3.2(3 > 
above. 

We were able to see quite easily in chapter 2 that primitive recursive 
definitions are meaningful, but with more complex recursive definitions 
this is not so obvious; conceivably there are no functions satisfying the 
proposed definition. This is where the first Recursion theorem comes in. 
Very general kinds of definition by recursion are represented by an 
equation of the form 

(3.3) f=<p(f) ■ 

where <P is a recursive operator. The first Recursion theorem shows that 
such a definition is meaningful; there is even a computable function 
satisfying it. Since in mathematics we require that definitions define 
things uniquely, we can say that the recursive definition (3.3) defines the 
least fixed point of the operator <P. Thus, according to the first Recursion 
theorem, the class of computable functions is closed under a very general 
form of definition by recursion. 



3.4. Exercises 

I. Find the least fixed point of the following operators: 

I2jt -1+/U-IJ ifi>0; 



I fix- 



if 1 = 0, 

fix -\, fix, y)) ifx>0. 
2. (McCarthy) Show that the function mix) given by 



m{x) j9l if^.oo. 



lx-10 



x- 10 otherwise, 
is the only fixed point of the recursive operator * given by 

otherwise. 
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3, Suppose that and tf' are recursive operators ^x^-* .F, (in 
the sense you have defined in exercise 1.7(5)). Show thai there is 
a least pair of functions /, g such that 

/=#(/; g) 

and /, g are computable. 

4. Suppose that 4»:&*x &„•>&* is a recursive operator (in the 
sense you have defined in exercise 1.7(5)). For each g€& m let 
tp s : &„ -* &,, be the operator given by <P K (/) = <P(f, g). 

Show that the operator } f f ig) = least fixed point of g is a 
recursive operator ir m -* & n . 



4. An application to the semantics nl' programming languages 

We shall sec in this section how the first Recursion theorem helps 
to resolve a problem in the semantics of computer programming 
languages - the area that deals with the question of giving meaning to 
programs. Our discussion is necessarily given in terms of a general and 
unspecified programming language, but this is adequate to explain the 
basic idea. 

Suppose, then, that L is a general programming language. The basic 
symbols of L will have been chosen with a particular meaning in mind, so 
that the meaning of compound expressions built from them is also clear. 
We may then envisage a simple program for a function as follows. 
Suppose that t{x) is an expression of L such that whenever the variables x 
are given particular values a, then r\ai can be unambiguously evaluated 
according to the semantics of L. If we now take a function symbol f of L 
that does not occur in r, then 

(4.1) fix) -rfc) 

is a simple program for a function f„ that has the obvious meaning: for any 
numbers a,f.ia) is obtained by evaluating the expression t(ft) according 
to the semantics of L. 

Suppose now that t is an expression in which the symbol fdoes occur. 
We indicate this by writing t(/, *}. Then the program (4.1) becomes 

(4.2) f(x) = r{f t x). 

This is now what is called a recursive program. Situations occur where this 
is the most natural and economical way to describe a function that we may 
desire the computer to compute. Yet the meaning of the 'program' (4.2) is 
not entirely clear. The fundamental problem with any recursive program 
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is: how do we give it a precise meaning? It can hardly be called a program 

until this question is settled. 
There are basically two approaches that provide an answer to this 

question: 

(a) The computational approach. Here the function taken to be 
defined by a recursive program is given in terms of a method of 
computing it. This approach reflects the fact that the computer 
scientist needs lo know not only what a program means, but also 
how to implement it. 

lb) The fixed point approach gives a meaning to a recursive 
program by an application of the first Recursion theorem. The 
fixed point theory also resolves some problems raised by the 
computational approach, and actually shows that the two 
approaches may be viewed as complementary rather than 
competing. 
Let us now briefly explain these two approaches and see how first 

Recursion theorem enters the picture. 



The computational approach This is best described by giving some 
examples. Consider the recursive program 



., ,, ,. . fl ifx=0, 

' 12/u-D ifx>0. 



[We are assuming that in L we can formulate conditional expressions such 
as this.) Using the equation (4.3) we can formally evaluate the value /{3J, 
for instance, as follows: 

/(3)«2x/(2)~2x2x/(l)=*2x2x2x/<0)~fc 

here we have made successive substitutions and simplifications using the 
formal equation (4J). Hence if/, is the function deemed to be given by 
the program [4,3] we would have / r (3)=8. 

With more complicated recursive programs there may be more than 
one way to use the formal equation /fx.i = r(/. *) in such an evaluation 
procedure. Consider, for uistance, the recursive program 

(4.4) /tart-fi **-* 

l/(x-i, /(*,>■)> ifx>o. 

Suppose that we try formally to evaluate f(1 t 0). We have 

(4.5: r(l, 01-/(0, /(1,0». 

But now there is a choice of occurrences of / for which to substitute 
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r{f, x). Choosing the leftmost one and simplifying we have 

/(I, 0) =■ A0,/<1, 0))= 1 (since x = 0). 

If, on the other hand, we substitute for the rightmost occurrence of f each 
time, we obtain from (4.5) 

/{1.0)-/(0,/(1.0))-/(0,/(0 1 /(1,0)J) 

=/(0,/{0./(0,/(l ; 0))))-... 

and in this case no 'value' for /( 1 , 0) emerges. 

A computation rule is a rule R that specifies how to proceed when 
confronted with such a choice of possible substitutions during any formal 
evaluation procedure. The computational rules we considered for the 
recursive program (4.4} were •leftmost' (LMt and 'rightmost' (RM). 
There are many other possible rules. For any computation rule R, and 
recursive program /(i) = t(/, x) we define the function f Tjt by: f rJl [a ) is 
the value obtained when f(a ) is formally evaluated using the rule R. If no 
value is thus obtained, f r jt{4) is undefined. (Thus for the recursive 
program (4.4) we have /,. LM ( 1 . 0) = 1, and A. RM iL 0) is undefined.) 

So we sec that each computation rule gives a meaning to any recursive 
program land, at the same time, a method of implementing in. 

The above example demonstrates that different computation rules may 
give different meanings to any particular recursive program. The problem 
now for the computer scientist who choose* this computational approach 
is to decide which computation rule to choose. Moreover, for any rule /?. 
there is the question of determining in what sense, if any, the function f Tji 
satisfies the equation 

nx)~rtf r x). 

The fixed point approach, using the first Recursion theorem, avoids 
these problems, and in fact sheds light on both of them, as we shall see. 



The fixed point approach An expression rif.x) of L gives rise to an 
operator :'?„-*&,, by setting 

<PigHx)-*7(g,x) 

for any ge U . Moreover, in most programming languages the finite and 
explicit nature of the expression rif.x) ensures that (p is a recursive 
operator. The first Recursion theorem now tells us that has a compu- 
table least fixed point, which we may denote by £. Thus we may define 
the function given by the program (4.2) as/.. This is quite reasonable, 
because f T is computable, :ind moreover we know that j r lxl = T(/„ x), 
which is surely what the programmer intended. 
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There remains the matter of finding good practical procedures for 
implementing the program (4.21 with its meaning defined in this way. It 
can be shown thai for any computation rule R, f rM c/, ; further, there are 
computation rules R for which f T . R = /, for all t. Any one of these may be 
chosen as a practical way of implementing recursive programs. Then we 
can say that the computational and fixed point approaches are comple- 
mentary rather than opposed to each other: the fixed point approach, via 
the first Recursion theorem, gives theoretical justification for the parti- 
cular computation rule chosen. 

There are further advantages in adopting the fixed point approach (or a 
computation rule equivalent to it): there is a variety of useful induction 
techniques for proving correctness, equivalence, and other properties of 
recursive programs with axed point semantics, and these can all be 
rigorously justified. 

For a full discussion of this whole topic the reader is referred to the 
books of Bird H976] and Manna \ 1974]. Here we have slightly simplified 
the framework within which the computer scientist works; in fact the 
hxed point f T he chooses is least in a slightly different sense (but still given 
by a version of the first Recursion theorem i. 



11 

The second Recursion theorem 



The first Recursion theorem, together with the Myhill-Shepherdson 
theorem in the previous chapter, shows that for any extensionai total 
computable function f there is a number n such thai 

The second Recursion theorem says that there is such an n even when f is 
not extensions!: we shall prove this in § 1 of this chapter. 

This theorem (and its proof) may seem a little strange at first. Never- 
theless it plays an important role in more advanced parts of the theory of 
compuiability. We shall use it in the promised proof of MyhilTs theorem 
(theorem 9-3.5) and in the proof of the Speed-up theorem in Ihe next 

chapter. 

In $ 1, after proving the simplest version of the second Recursion 
theorem, we describe some applications and inter pre tat ions of it: § 2 is 
devoted to a discussion of the idea underlying the proof of the theorem, 
and other matters, including the relationship between the two Recursion 
theorems. A more general version of the second Recursion theorem is 
proved in § 3, and is used to give the proof of Myhill's theorem. 

1 . The second Recursion theorem 

First let us prove the theorem, and then see how we can under- 



stand it, 



1.1. Theorem iThc second Recursion theorem) 

Let f be a total unary computable function; then there is a number n 
such that 

Proof. By the s m-n theorem there is a iota! computable function six) 
such that for all x 
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(If A«{x) is undefined, we mean the expression on the left of {") to be 
undefined: alternatively, we can take the left of (*) to denote 

Now take any m such that s — $ m \ rewriting (*) we have 

Then, putting x = m and taking n =t*>^(m) i which is defined, since $ m is 
total) we have 

cVm i(y} = <My> 
as required. □ 



In spite of its appearance, for non-extensional functions f this is not a 
genuine fixed-point theorem: there is no induced mapping & -»<£/,.,) of 
computable functions for which cV could be called a fixed point. 
However, we do have an induced mapping/* of programs given by 

To expect a fixed point for f* in general would be too much; this would be 
a program P r such that/*(P B ) and P„ are the same; i.e. fin ] ■ n. But what 
theorem 1.1 says is that there is aprogram P n such that/"*!/ 7 ,, 1 andF, have 
the same effect (when computing unary functions); i.e. tp (i „ : = <*„. Thus the 
second Recursion theorem is loosely called a pseudo- fixed point theorem ; 
and for convenience, any number »i such that <£/,„; = 6 n is called a fixed 
point or fixed point value for/. 

The second Recursion theorem is a result about indices for computable 
functions; it may be thought therefore that the proof rests on some special 
feature of the particular numbering of programs that has been chosen. 
Inspection of the proof shows, however, that we used only the s-m-n 
theorem and the computability of the universal function: neither of these 
results depends in any essential way on the details of our numbering. 
Moreover, theorem 1.1 can be used to establish the second Recursion 
theorem corresponding to any suitable numbering of programs; see 
exercise 1.10(9) below. 

There are various ways in which theorem 1.1 can be generalised, 
although the idea underlying the proof remains the same. In exercise 
1.10(7) we have the generalisation to k-Zty functions for ft>l; in 
theorem 3.1 it is shown that a fixed point can be calculated effectively 
from various parameters that may be connected with /. 

We continue this section with some corollaries and applications of the 
second Recursion theorem. 
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1.2. Corollary 

Iff is a total computable function, there is a number n such that 
Wf^=W n andE fil: =E n . 
Proof. If0 /:nl = <k, then W itn) =W n and E, MI = E„ D 

1.3. Corollary 

If f is a total computable function there are arbitrarily large 
numbers n such that <j>a*) — $*■ 
Proof. Pick any number k: lake a number c such ihar 

4> c ^ d> v , <£i, #*. 

Define a function g by 

c if is k, 
fix) \tx>k. 

Then g is computable; let n be a fixed point for g. If nSifc, then 
«£*.*.■ = <k^<£«. a contradiction. Hence « > k, so f{n) — gin) and « is a 
fixed point for /. D 

(In exercise 1 .10(8) we shall indicate how the proof of theorem 1 . 1 can 
be modified to obtain an increasing effective enumeration of fixed points 
for /.} 

The following corollary summarises the way that the second Recursion 
theorem is often applied, in conjunction with the s-m-n theorem. 

1.4. Corollary 

Let f{x. y) be any computable function : then there is an index e 
such that 

Proof. Use the s-m-n theorem to obtain a total computable function s 
such that <* it ,ily)-/(*. >'); now apply theorem 1.1. taking e as a fixed 
point for $. D 

As simple applications of this corollary, we have 

1.5. Examples 

ia) There is a number n such that tM* ) = -*", all x: apply 
corollary 1 .4 with f(m, x) = x m : 



(b) there is a number n such that W M = (n\: apply corollary 1.4 
with 



lui 



ify=i. 

mdefined otherwise, 
obtaining an index n such that <My» is denned iff y=n. 



The second Recursion theorem received its name because, like the first 
Recursion theorem, it justifies certain very genera] definitions 'by recur- 
sion'. Consider, for example, the f ollowing 'definition' of a function &,, in 
terms of a given total computable function /: 

The function d> e is 'defined' effectively in terms of an algorithm for 
computing itself (coded by the number e I. In spite of its appearance as a 
circular definition, we are told by the second Recursion theorem that 
there are computable functions <&, satisfying such a definition. 

It is often useful in advanced computability theory to be able to make 
an even more general definition of a function <*, 'by recursion* of the kind 
<t>Ax) = gie,x), 

where g is a given total computable function. Again, think of d> e as 
defined' effectively in terms of a code tor its own algorithm. Then the 
second Recursion theorem, in the guise of corollary 1 .4. makes this kind 
of definition meaningful also. We shall use this fact in the Speed-up 
theorem in the next chapter. 

We continue this section with some further straightforward, but some- 
times surprising, consequences of theorem 1.1. First, we show how it can 
be used to give a simple proof of Rice's theorem (6-1 .7). 

1.6. Theorem (Rice). 

Suppose that 2 c.^c '4 l .andletA={x:d> K €tf). Then A is not 
recursive. 

Proof. Let a € A and be A. If A is recursive, then the function f given 
by 



M 



-{ 



a iixfA. 
h itxeA, 



is computable. Further, /has the property that x a A <=> fix) £ A, for all x. 
On the other hand, by theorem 1.1. there is a number n such that 
4>r.m = <frr, so fin) £ A oneA a contradiction, d 
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Another application of the second Recursion theorem shows, as prom- 
ised in chapter 4^2, that the 'natural' enumeration of computable 
functions without repetitions is not computable. 

1.7. Theorem 

Suppose that f is a total increasing function such that 

(a) if m*n, then *„„,,* 4>f ini , 

(b) A") "" 'Ae least index of the function <&•.„•■ 
Then f 'is not computable. 

Proof. Suppose that f satisfies the conditions of the theorem. By (a ), / 
cannot be the identity function, so there must be a number k such that 

whence, by (b) 

<i> lin ,*<t> n (n>k). 

On the other hand, if / is computable, then by corollary 1.3 there is a 
number n^k such that <b itn ■ = .£„, a contradiction. Q 

Applications of the second Recursion theorem such as the following 
can be interpreted in anthropomorphic terms. 

Let P be a program. We can regard the code number y{P) as a 
description of P. We could regard the program P as capable of self- 
reproduction if for all inputs x the computation P{x) gave as output its 
own description. y(Pi. At first glance, it would seem difficult to construct 
a self-reproducing program P. since to construct P we would need to 
know yiP), and hence P itself, in advance. Nevertheless, the second 
Recursion theorem shows that there are such programs. 

l.S. Theorem 

There is a program P such that for at! x, P\x)lyiP); i.e. P is 
self-reproducin g. 

Proof. If we write n for ylPi. the theorem says that there is a number n 
such thai 

<M-»:» = n<foralI*). 

To establish this, simply apply corollary 1.4 to the function f(m. x) = 
m. O 

We turn now to psychology! Recall the notation and terminology of 
chapter 5. There we denned a total computable function trie.*, t) that 
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codes the slate of the computation P e tx » afier t steps; a(e, x, t) contains 
information about the contents of the registers and the number or the 
next instruction to be obeyed at stage t. It is clear, then, that complete 
details of the first t steps of the compulation P,u ) arc encoded by the 
■lumber 



o" le. 



.*.*)= it i>nr-". 



Let us call the number tr'ie.x. t) the code of the computation P e tx) to l 
steps. Clearly or* is computable. 

Suppose now that we are given a total computable function & and a 
program P. By the ^-analysis of the computet lion P[x) we mean the code 
of the computation P{x) to if/fa) steps. We call a program P ^-intro- 
spective at x if P(x) converges and gives as output its own ^-analysis; 
we call P totally w-i*urospeclive if it is ^-introspective al all x. 

1 .9. Theorem 

There is a program P that is totally ^-introspective. 
Proof. Simply apply corollary 1.4 to the computable function fie, x) = 
(T*(t, x, ip{x)), obtaining a number »: such that 

0-{x) -f(n,x\- the (//-analysis of P n {x), D 

We close this section with a tale in which the second Recursion theorem 
appears in military dress. 

'We are at war. An operation is mounted to sabotage the enemy's 
central computer facility. Our special agents have penetrated the enemy 
defences and found a means of entry to the high security building that 
houses all the programs 

Pi.,Pi,P^.. 

for the central computer. The mission will be accomplished if our agents 
can systematically sabotage all of these programs, ensuring that 
subsequently no program will operate as the enemy thinks it will. Simply 
to destroy the programs is not sufficient: the enemy would soon discover 
this and set about rewriting them. What is needed is a subtle alteration to 
each program, so that, unknown to the enemy, the computer will give 
wrong results. Swiftly and silently our men move into action . . . 

Alas, defeat at the hands of the second Recursion theorem! Whatever 
systematic plan is devised to modify the programs, it will define an 
effectively computable function f by 

f{x) = the code of the modilieation of P.. 
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The second Recursion theorem springs into action, producing a number n 
such that P„ and its Transform P* ; ,i have the same effect ion unary inputs, 
at least*. The operation was bound lo fail. 

(Sometime later, back at HQ. our master strategists consider recruiting 
a chimpanzee whose mission is to alter the programs in random 
fashion . . . )* 



1.10. Exercises 

1. Show that there is a number n such that c\u) = [v.t]. 

2. Show that there is a number n such that W„ —E n — nU. 

3. Show that there is a number e such that S,ixS = e~ for all x. 

4. Is there a number n such thai W r -{x:<f> rj tx)t}} 

5. Suppose that jtf c: €i, and let A = {*:<£, £,#"}. Show that .4 **,A. 
Deduce theorem 1.6. 

6- Give an example of a iota! computable function f such that (i) if 

tj>, is total, then so is ^tixh i'i' there is no fixed point n for / with 

d» total. 
?. Prove the second Recursion theorem for A-ary computable 

functions: if / is a total computable function there is a number n 

such thai 

<Pi<n\ ~*Pr. - 

8. Show that theorem i.l may be improved to: For any total 
computable function f, there is an increasing recursive function 
n(0 such that for every /, ffr„uf =t famit)}- (ffint. Examine the 
proof of theorem 1.1; note first that from our proof of the s—m-n 
theorem we have s{x}'^x for all x (or else show that by adding 
some redundant instructions to the end of P iU , an equally 
suitable computable function 5 (*) can be found, with s'[x'\*z x). 
Now observe that given any number k we can effectively find an 
index m for six) with m'^k. Then, following the proof of 
theorem 1.1, we have that n = sim) is a fixed point for /, and 
n=i(»i'i>m>t. It is now a simple matter to construct a 
function n{t) as required.) 

9. Prove that the second Recursion theorem does not depend on 
the particular effective numbering of programs that is chosen. 
[Him. Let S be another effective numbering of programs; let 
Qm = program given code number m by iS ; let ip*, = the unary 
function computed by Q„. We have to prove that for any total 
computable function f there is a number n such that ipfi*\ ~ <fr* 
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For this, show that there is a computable bijection r such that 
P. = <?-:, ,; then show that it issufticient to establish that there is a 
number »: such that <£. V-i-i =&*•> 

10. Suppose that in the tale just before these exercises, our special 
agents find that the enemy's computer operators have become 
extremely sophisticated - they have only one program, a uni- 
versal program. Can our men now completely accomplish their 
task? 

11. Could a chimpan/ee succeed where the special agents failed? (A 
philosophical problem.* 

2. Discussion 

The second Recursion theorem and its proof may seem a little 
mysterious at first. We shall see, however, that it is essentially a simple 
diagonal argument applied to effective enumerations of computable 
functions. 

Suppose that h is a computable function. If h is total, then the 
enumeration E given by 

is an effective enumeration of computable functions. If h is not total, we 
can still regard A as enumerating a sequence of computable functions E 
by adopting the convention that for any x the expression <*>h\, • denotes the 
function given by 

Ic6jit«i(y) if A(.o is defined, 
.undefined if h ix) is undefined. 

Thus, if hixi is undefined, .S^,, is the function that is nowhere defined. 
The following lemma shows that the sequence E thus enumerated by h 
is an effective enumeration even when h is not total. 



2.1. Lemma 

Suppose thai A is a computable function. There is a total compu- 
table function h' sttch that h and h' enumerate the same sequence of 
computable functions. 
Proof. The s-m-n theorem gives a total h 1 such that 

We can now explain the idea underlying the proof of the Recursion 
theorem. For any k, let us denote by E k the sequence of computable 



// The second Recursion iheo 



'cm 



208 



functions effectively enumerated by #*; then the list E,t, E\, E;, . . . 
includes a!! possible effective enumerations of computable functions. We 
can display the details of these enumerations as follows (ignore the 
circlesi : 



Ev' 


<$**») 


<*«»l. 


*.*:> 


***-*■ 


*'<: 


^•hii 


<S^ 


*«i<:> 


*•:<* 


E 3 : 


*#.■«! 


**><!» 


(®^T) 


^.1* 



ft~* 



*«H.'l 



'*.lll 



«, 



(feD 



Then the diagonal enumeration, D, circled on this array, is given bv 

Thus D is an affective enumeration, given by the computable function 
hlx)^tf> x ixi. Moreover. D has an entry in common with each effective 
enumeration E; in fact, for each k, D and E k have their \k- l)th entry 
<*a„i*i In common. 

Suppose now that / is a total computable function. Then we ean 
'operate* on D to give an enumeration D" given by 

Now D* h an effective enumeration of computable functions (given by 
fihix I)) so there is a number m such that D* = E,„. By lemma 2.1 we may 
assume that <b„ is total. As noted above. D and £„ have their (m + 1 )th 
entry in common, i.e. 

Since $*, is total, the number 4>„(m) = n, say, is defined, and 

The argument is simply illustrated as follows: 



D: 






&&.&> 



>+?>.2< 



D* = E„ 



'^/t* ift:»^.''.*id'i«i , .'.*j(j'i • • • <*m#*i™.> — ^*~""i 



So n =0„(ntl is a fixed poini. 

Note. This proof can be rephrased to appear similar to standard diagonal 

arguments as follows. Suppose thai /is a total function such that <£»;„, »* $ r 
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for all n : then using / on the diagonal enumeration D, the enumeration 
D* is constructed so as to differ from E\ at k ifulfilling the requirements 
of the diagonal motto). Hence D* is not an effective enumeration, so / 
cannot be computable. 

The second Recursion theorem can thus be viewed as a generalisation 
of many earlier diagonal arguments. To illustrate this, we show how to use 
the second Recursion theorem to prove that K is not recursive, one of the 
fundamental diagonal arguments. 

2.2. Theorem 

K is not recursive. 
Proof. Let a, b be indices such that W a = and W h = W. If K is 
recursive, then the function g defined by 

a IfxsK. 
b ifveK, 
is computable. Notice that g has the property that for all x 

(since x e W ttl O W,,.i-N o g{x) = b 4=> x€ W\). This is in contra- 
diction to the second Recursion theorem. D 



gl*.' = 



Remark. We have, of course, used a sledge hammer to crack a nut. The 
point about this proof is that all diagonalisation is hidden inside the 
application of the Second Recursion theorem. We are not suggesting that 
the earlier proof should be replaced by this one. 

The relationship between the two Recursion theorems Suppose that 
<"P:^i-»S"' 1 is a recursive operator, and that h is a total computable 
function such that $(4.) -4*,*' for all x i.as given by the Myhill- 
Shepherdson theorem). If n is a fixed point for h, then <&,eo = «ta *-*■ 
&\<i>c) = d> n - Thus the second Recursion theorem tells us (as does the first 
theorem 1 that 0has a computable fixed point: it docs not tell us, however. 
that has a computable least fixed point. So, for recursive operators the 
first Recursion theorem gives us more information. 

On the other hand, the second Recursion theorem applies to non- 
extensional computable functions as well; i.e. functions that do not arise 
from recursive operators. Thus the second theorem has a wider range of 
application than the first theorem, although in the area of overlap it 
generally gives less information. Thus, these two theorems are best 
regarded as complementary, although a case is made by Rogers [1967] 
for the view that the second theorem is the more general of the two. 
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3. My hill's theorem 

Let us now formulate and prove the generalisation of theorem 
1.1 needed for MyhiU's theorem. Suppose we have a total computable 
function f[x, ri; theorem 1.1 shows that for any particular value of the 
parameters z there is a number n such that d>f inxl = 4> n . We now show that 
n can be obtained effectively from z. 

34. Theorem (The second Recursion theorem) 

Suppose that f{x, x) is a total computable function. TJiere is a total 
computable function n (z) such that for all z 

Proof. We simply introduce the parameter at appropriate points in the 
proof of theorem 1.1. 

By the s-m-n theorem there is a total computable function stx, z ) such 
that 

Then. again by using the s-m-r, theorem, there is a total computable 
function m(z)such that.?U, z) = 4*> m1I ,(x). Rewriting (*) we have 

Then, putting x = miz) and setting «■;«)- ^« ( „(mu)) we have 

as required. I~l 

We proceed immediately with the proof of My hill's theorem (theorem 
9-3.5). 

3.2. MyhiU's theorem 

Any creative set is tn*compleie. 
Proof. Suppose that A is creative and B is r.e.; we must prove that 

Let p be a productive function for A. Define a function fix, y, z) by 
if z=/?U»and ye /?, 

. undefined otherwise . 

Then / is computable, so by the s-m-n theorem there is a total compu- 
table function s(x, y) such that 

<t> i , I . yl lz) = f{x.y.z). 



Then, in particular 



"*U.vl ~ 



/U.y,z> = 









" i(y . — 



{pix)} ityeB, 

otherwise. 

By the second Recursion theorem (theorem 3.1) there is a total compu- 
table function nly) such that 

for all y. Thus, for all y 

{p[n(y'») ifyeR 

2 otherwise. 

We claim now that 
(**) yeB iff pin{y))€A, 

(at Suppose that yeB. then W„M=[p(n(y))), Uptfi(y))*A, 

then W r , y} sA, so by the productive property of p. 
p(n(y)l£ IV, ly „ This is a contradiction. lltnce pin{y))c A. 
i.b) Suppose that yeB, then W H(r , = 0sA. By the productive 
property of p, pin (y )) € A. 
The claim (**) is thus established, so Bs„A since p{n{v)) is compu- 
table. □ 

3.3. Corollary 

The m-degree 0,'„ consists of alt creative sets. 

3.4. Exercises 

1. Prove the following generalisation of theorem 3.1: For any 
number k there is a total computable function nie.z) (where 

z = U- Zk)) with the following property: if z is such that 

fa * (x,z) is defined for all v. then 

{Hint. This can in fact be derived as a corollary to theorem 3.1.) 

2. Formulateand prove the resultthat improves theorem 3.1 in the 
same way that exercise 1.10(8) improves theorem 1.1. 
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12 

Complexity of computation 



In (he real world of computing, ihc critical question about a function / is 
not b f computable?, but rather Is f computable in practical terms? In 
other words. Is there a program for f that will compute / in the time tor 
space) we have available? The answer depends partly on our skill in 
writing programs and the sophistication of our computers; but intuitively 
we feel that there is an additional factor which can be described as the 
'intrinsic complexity' of the function / itself. The theory of computational 
complexity, which we introduce in this chapter, has been developed in 
order to be able to discuss such questions and to aid the study of the more 
practical aspects of computability. 

Using the URM approach, we can measure the time taken to compute 
each value of a function / by a particular program, on the assumption that 
each step of a URM computation is performed in unit time. The time of 
computation thus defined is an example of a computational complexity 
measure that reflects the complexity or efficiency of the program being 
used. (Later we snail mention other complexity measures.) 

With a notion of complexity of computation made precise, it is possible 
to pursue questions such as How intrinsically complex is a computable 
function f? and Is it possible to find a 'best' program for computing /? 

The theory of computational complexity is a relatively new held of 
research ; we shall present a small sample of results that have a bearing on 
the questions raised above. At the end of the chapter we shall provide 
suggestions for the reader wishing to pursue this topic further. 

We begin in § 1 by defining some notation: after some discussion we 
proceed to show that there are arbitrarily complex computable functions. 
Section 2 is devoted to the surprising and curious Speed-up theorem of 
M. Blum, which shows in particular that there are computable functions 
having no "best* program. In § 3 we introduce the idea of complexity 
classes and prove Borodin's Gap theorem; in the final section we show 
how we can use complexity classes to give a pleasant characterisation of 






'/'(*) = 



the elementary function* - an important subclass of the primitive recur- 
sive functions. 



I . Complexity and complexity measures 

We begin by establishing some notation. 

1-1. Notation 

(a) For any program P, we write t^' for the function given by 
the number of steps taken 
by P to compute /?'(«}, if ff lx) is defined. 

undefined otherwise, 

= nHPix)l in f steps). 

(b) For any index e we write t^ix) for tpj{x). We shall write t P 
for fj» and t e - for t t l> as is customary. 

The collection of time functions f," constitutes an example of a 
computational complexity measure. Some simple but important properties 
of these functions are given in the following lemma. 

1.2. Lemma 

(a) DorrU^'" i = Domi'*,"'), all n, t>. 

yb) For each n the predicate M\e, x.y) defined by M{e, x,y\m 
;r{x)^yisdecidable. 
Proof, (a) is obvious: lb) follows from corollary 5-1.3(6). D 

Remark. The property IM is used frequently in complexity theory; it 
stands in marked contrast to the fact that #»**(*)*■¥ is an undecidable 
predicate. 

Often in complexity theory a property holds for all sufficiently large 
numbers n, though not necessarily for all it. Thus we make the following 
definition. 

1.3, Definition 

A predicate M{n ) holds for almost ail n, or almost everywhere 
ia.e.> if M(nl holds for all but finitely many natural numbers n (or, 
equivalently, if there is a number n Q such that Mini holds whenever 
n>na). 

We can now state our first theorem, which shows that there are 
arbitrarily complex computable functions. 
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1.4. Theorem 

Lei b be a total computable function. There is a iota! computable 
function f, taking only the values (1, 1, such that if e is any index for f, then 

Et(«)> b(n)a.0. 

Proof. The reader should not be surprised to find lhai / is obtained by a 
diagonal construction. The essence of the construction is to ensure that if 
/i(m)s£lw) for infinitely many values m, ihen/ differs from c> at one of 
those values. We define / by recursion as follows 

At each stage n in the construction of /"we shall either define an index 
i„ or decide in a finite amount of time that u is to be undefined. We then 
ensure that /in) differs from <£,„(«) if /„ is defined. In detail, assuming that 
flO), .... f[n - 1 ) have been thus defined, we put 

!**./[/ :£ n and i differs from all previously 
defined i* and f,\ni^b[n)] if such an / exists, 
undefined otherwise. 

_ _[1 if f„ is defined and #,_<;« > = 0, 
10 otherwise. 

There is a finite procedure thai tells us for a given / whether A(n)^ 
b{n), since 

t.ini^bin) o 3ysA(n)(r,(fl)aey), 

and the right hand side is deeidable by lemma 1,2(6). Hence there is an 
effective procedure to decide whether i„ is defined, and if so, to find its 
value Moreover, if r„ is denned, then so is 4> tfl {n). Hence / is a well- 
defined total computable function. 

Suppose now that/- = tf> f ; by construction e r- i n whenever f„ is defined. 
We shall show that if ; is any index such that U{m)sb(m) for infinitely 
many m. then / = (, for some n, and hence i 9* e. This is sufficient to show 
that t e {m)>b{m) for almost all m. 

Suppose then that t,{m)nbtm) for infinitely many m. Let p = 
I + max{fc : i k is defined and i k < i} (put p = II if there are no defined i* < f i. 
Choose n such that n =* :. p and t : (n ) sb{n). If r = i k for some k < »:. there 
is nothing further to prove. Assuming then that / ^ i k for all k < n, we 
have at stage n : 

isn and / differs from all previously defined ii and t,<ni^b{n). 

Thus, from the definition of /„. f„ is defined and i, £ f. Bui sineu n a p, vvc 
must have i„ £: i. Hence i, = i, as required. □ 
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We cannot in general improve this theorem lo obtain the conclusion 
t e (n)>b(n) for alt n, this is because for any f we can always write a 
program that computes / quickly for some particular value a, simply by 
specifying the value of /(a) in a preface lo the program. For example. 
suppose that f{a)= 1; let F be a program thai computes f. Then the 
program F ' based on the flow diagram in fig. 12a also computes/. Clearly 
we have t P (a)=a + 3, Thus, if b is a computable function such lhat 
fct*)>*+3 for some x, then we cannot obtain the conclusion of theorem 
\A with t e in) > bin) for all n. 

Using a similar idea we can write a program that computes /quickly for 
any given finite number of values: sec exercise 1.8(1; below. Thisshows 
lhat t l (n)>b(n) a.e. is the best possible conclusion in theorem 1.4. 

Other computational complexity measures There are many other 
natural ways to measure the complexity of a computation, of which the 
following are a few examples. For simplicity we restrict our discussion to 
unary compulations. 



Fig. 12a. 



v IAKT 
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3. For the complexity measures given in example 1.5(3), verify 
lemma 1.6, expressed in the following terms. For any Turing 
machine W, lei fst be the unary function computed by M. Then 
show that 

{a) Domi^f '• = Dom(/M>, 
lb) '*flvUl~* v' is deeidable 
(i) when 

the number of steps taken in computing / M (x) 

using M, if f M {x ) is defined, 

undefined otherwise. 



<£*, {x > = 

(iil when 



(the length of tape actually used" in the 
computation of f M ix)byM, if fst{x)i$ defined, 
undefined otherwise. 

4. Suppose that &£r] and V,U> are two abstract computational 
complexity measures. Show that & e and *l f t are recursively related 
in the following sense: there is a recursive function r such that for 
any t 

9 u {n) s /)•!. <P,i n (') and #,(n)sr(«, ^(n)) 

For almost all n for which & c in) and tP*tn) are defined. {Him. 
Consider the function r defined hy n>. m) — max{0.(«(, *P (n): 
e^n and 0..i«) = /?i or , I / C {n) = m\.) 

Show further that if t {n), \F r {ft)^n whenever defined, there 
is a recursive function r such that (P,(»)^ r[<p t (n\) and d> r (n)^ 
K**(b)) whenever &(it) and "/',;«) are defined. 



2. The Speed-up theorem 

Suppose that P and Q are programs for computing a total 
function f, such that for any x 

ItoixXwx). 
We would naturally say that Q is more than twice as fast as P. One 
instance of the Speed-up theorem tells us that there is a total function f 
with the following property: if P is any program for /, then there is 
another program for f that is more than twice as fast on almost all inputs. 
Thus, in particular, there can be no best program for computing/. 

~ We say that a Mjuarc on the tape is used\[ ili* scanned during rhccomputsiioi or 
lies between I tie outermost ncr. -blank square on the initial uipe lindudingtlu -• 
outermost squares) 






The Speed-up theorem will give speed-up by any preassigned 
(computable) factor: the example above represents speed-up oy a factor 
of 2. given by the computable function r{x)=2x. The proof of this 
theorem is probably the most difficult in this book. First we prove a 
pseudo-speed-up theorem, which contains most of the work The Speed- 
up theorem then follows quite easily. 

2.1 . Ttie pseudo-Speed-up theorem (Blum) 

/>/ r be a total computable function. There is a total computable 
function f such that given any program P for f. we can find a P, with the 
properties 

la) <*}, is total and <*>,ix ) - fix ) a.e., 

lb) r(ij{x))<t,\x) a.e. 
[Note. This is pseudo-. speed-up in that we do not necessarily have 
df,\x) =f(x) for ali x, as will he the case in the Speed-up theorem.) 

Proof. First we must fix a particular total computable function s given 
by the s-m-n theorem, .such that $'? lu, #)**&(*,«)(*>■ 

We shall find a particular index e such that ff 1 is total and has the 
following properties, where we write g, for the function given by gJx)= 
£ f iU.Xi: 

U»l go = f the function required in the statement of the theorem. 

lb) for any «, g„'» = g,.i>) a.e., 

(r) if /= <£, then there is an index / for &+, such that r(//(i))< 

(,(»') a.e. ; in fact we can take /' = s{e, i — 1 ). 
Clearly this is sufficient to prove the theorem. 

For the moment think of e a* arbitrary but fixed. Thinking of u as a 
parameter, we shall define a computable function g(u, x », which will also 
depend implicitly on e in an effective way. For a particular e which will be 
chosen later, p will be the function <£?' above. The definition of g is by 
recursion on x, with u fixed, as follows. 

For any x,g[u,x) is denned only if £(n,0), .. . ,g(u, x - II have all been 
defined, and in the process some finite sets of cancelled indices 
d,i>i Cb.1-. • - • , C,«_i have been defined. Suppose that this is the ease. 
Vow set 



>■-■ 



'f '«(*■* < iM 1 is defined ior u^i<x, 
undefined otherwise. 
(Of course, if x < u then C lu , = Z and is defined). Note that for any i. if 
W+i'Ul is defined, we can decide whether /;U)s'(*..,.(-i»<x)) (using 
lemma 1.2(A)}, whether or not *,(*) is defined. 
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~ The Speed-up th 



aire": 



Then glu.x) is given by 



l-max{cVx) feC,,.,} if Cm* is defined, 

undefined otherwise. 



(If C u ., is defined, then for any i ; e C, we musi have «&(>) defined, so 
g(«, at) is certainly defined in (his case.) 

By Church's thesis, g. as thus defined, is a computable partial function 
which depends implicitly and effectively on the value of e. Hence, bv 
corollary ] 1-1.4 to the second Recursion theorem (slightly generalised) 
there is an index c such that 



{*) 



a 



[It. x . 



From now on let e be a fixed index such that (*) holds; then e is the index 
mentioned at the beginning of the proof We must verify that it has the 
required properties. 

First we show that !*) implies that g is total. Fix x ; for u '^x, C u _, = so 
g{u, j) = I immediately from the definition. For u<x we show that 
giu, x) is denned by reverse induction on u. Suppose then that g(*,x), 
gix-Ux), . . .,glu +2,*), glu + i,x ) are all defined. Then from (*) and 

the definition of s we have <£„..., ,■>}. &.> lt -n(.t} $ntM*iM are all 

defined ; hence so arc r,„,,- : ,u! for u & i < x. This in turn means that C Uil 
is defined, hence giu, x) is defined also. Thus g(«, x) is a total function. 

Now, writing g* for the function given by g„ [x) - giu, x) we have 

gjx)-g(u, x) 

= <!>?\u,x)<fromn) 

— 4>ium<(x) {by definition of s). 

We must verify the properties (a)-(cl above. 

[a ) If we put f = g u . then / is certainly total, as required by the 
theorem. 

(b) Fix a number u ; we must show that g{0. x » and gi u, x i differ 
for only finitely many x. It is clear from the construction of the 
sets C, that for anv x 



C. =C v ,,^{«.m4I 



*-l*. 



Since the sets C, Xx are all disjoint (by construction) we can find 
the number v = max{x:Cf... contains an index /<«}. Then for 
x > v we have Co.* £{«,« + 1, ... ,4T— I), and hence Co., = C... 
This means that g(0 t x) = glu.x) for x>v. Thus goU) = g„lx| 
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(c) Suppose that t is an index for/; taking/ = j{e, / + 1 , we have 
that ^ = # ilfcl _ 1( = #,+, .;from above), so/ is an index for g, , ,. We 
can prove that 

rit,(x)) = nhu. . of*)) < t.ix) for all x > i. 

If this were not the case, then f would have been cancelled in the 
definition at giO.x) for some *>;; i.e. there would have been 
x > i with i £ CV,..,. But then, by construction of g, we would have 
g'Axi-f&ix). a contradiction. This completes the proof. □ 

Note that the pseudo-Speed-up theorem is effective: given a program P 
for / we can effectively rind another program that computes / almost 
everywhere, and is almost everywhere faster than P. 

We now show how to modify the above proof to obtain 



2.2. Vie Speed-up theorem (Blum) 

Let r be any total computable function. There is a total computable 
function fsuch that, given any program P, forf, there is another program P k 
lor f such that r(l k ix )) < ti(x 1 tf.e. 

Proof. We may assume without any loss of generality that r is an 
increasing function (or else replace r by a 'arger increasing computable 
function). First, by a slight modification of the proof of theorem 2.1 we 
obtain a total computable function /such that given any program P, for f, 
there is a program P, such that 

(a) <b, is total and <f>,\x) = f{x) a.e., 
lb) r(tfix)+x)<tihc) a.e. 
To do this, simply rewrite the definition of C , replacing ... and 
4U)sr(/ lW+1 ,f>))' by ' . . . and &U):Sr(* (W+1 ,fr)+x))". We shall show 
thai the function /so obtained is the function required by the theorem. 
Suppose then that f = 4>, and / is chosen with the properties ia\ (A) 
above. Our aim now is to modify P, to produce ;. program P r that 
computes /for ailx. Suppose that <j> l (x) = f(x) for all x > v. Let f(m) = b m 
for msp, We modify P, by writing some extra instructions at the 
beginning designed to give these values for m s v. Specifically, let P r be 
the program that embodies the flow diagram given in fig. 12*. Clearly P r 
computes /; moreover, there is a number c such that the extra instructions 
add at most c steps to any computation: i.e. for all x 



a.e. 



t r U)S/,{x) 



C. 
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1.5. Examples 

1. ''number of jumps made in executing P e {x), 

0,ix)=\ itPAxll 

[undefined otherwise. 

This measure is closely associated with the number of loops 

performed when executing P e {x), which is in turn related to the 

time of computation t f [x). 

the maximum number held in any of the registers 
at anv time during the computation P,u ) 

undefined otherwise. 

This measure obviously relates to the amount of storage space 
needed to carry out the computation P*{x) on a real computer. 
With the Turing machine approach, two natural complexity 
measures are (i) the number of steps needed to perform a Turing 
computation and (u) the amount of tape used to perform a 
computation. 



In general, an abstract computational complexity measure (for unary 
computations') is defined to be any collection of functions <P, having the 
abstract properties that were given by lemma 1.2 for I.. 



1.6. Definition 

A computational complexity measure is a collection of functions 
: with the following properties: 

[a ) Dom(<Jv) = DomiS, ), for all e ; 

(b) The predicate '*pAx) — y' is decidablc. 

1.7. Lemma 

The. functions given in examples 1.5 above are computational 

complexity measures. 
Proof. We give sketch proofs for the examples 1.5(1) and 1.5(2), 

leaving 1.5(3) as an exercise (1.8(3) below). In each case it is only part [b] 

of definition 1.6 that requires any thought. 

ill To decide *ds«{*)=*y', where 4>,i>) = number of jumps made 
during P e tx). Suppose that P e has s instructions; then at most s 



VVcncsn here thai if a jump instruction Jim. /.•, f?< is encountered, then a jump (to 
/,) is made it .-„, -r H ; but rioi otherwise. 
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consecutive steps of P.U) can be performed without making a 
jump. So run P,U) for up to l-;y-l)v steps. If P.{xt stops in 
fewer than this number of steps, then count the number of jumps 
made to see if it is y. Otherwise (i.e. if P,{x) has not stopped after 
1 + (y - 1 Is steps) P t ix ) will have performed at least y + 1 jumps. 
so we conclude that 4,1x1 />-. 

(2) Todecide - & r ix >=■ y\ where <t> t i.x) = maximum number held 
in any register during P,[x\. Let u = p{P r ), and consider all 
possible non-halting states under the program P, with 
r,, . . . , r u < y. There arc sty + 1)" such slates that are distinct. 
RunP,(x) for up to l+ily-l)" steps. If P,i>) stops after this 
number of steps or fewer, then find the maxunum number that 
has occurred in any of the registers and see if it is y. Otherwise (if 
P.(x| has not slopped* one of two possibilities will have occurred: 
(il the computation has been in the same state on two separate 
occasions, so P,i.v) is in a loop and <P,(i) is undefined: (ii) there 
has been no repetilion of stales, in which case some register has 
contained a number greater than y. In bolh cases we conclude 
thai 0,\x}*v. ~3 



Note lhat in proving theorem 1 A we used only the properties of ;,. given 
by lemma 1.2. Thus theorem 1.4 holds for any computational complexity 
measure. There are many other resulls in complexity theory which do not 
depend on any particular measure of complexity. Such results are said to 
be machine independent. The Speed-up theorem of the next section and 
the Gap theorem of § 3 are further examples of such results. 



1 -S. Exercises 

1. Let / be a total computable function that takes only the values 
0, 1. Show that for any m there is a program F for/ such that 
fFv*) s 2x + 3 for all i<m, Deduce that if b is a computable 
function such thai b{x)> 2x - 3. then the restriction to almost all 
n in theorem 1.4 cannot be improved. 

2. Let 0, be the complexity measure given in example 1.5(2). Show- 
that whenever &(*) is denned, then #,(*>^max{x, £«{*)). 

Let / be any total compulable function, and lei X be a finite 
subset of Dom(/). Prove lhat there is a program P, for / that is 
the best possible on X (for this measure); i.e. & t {x) = 
maxlx, <b P \x U for x&X. 
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Fie. 12ft. Speed-up from pseudo-Speed-up. 
Si *si 



2. It can be shown ihat the Speed-up th 



eorem is not in general effective. 








STOP 

Thus we have 

r(/,»(x))«/ , 0,(x) + c) [since r is increasing) 

</,<x)a.e. 
Hence, taking A =/" the Iheorcm is proved. 3 

Remarks 

1. The above proofs of the pseudo-Speed-up and Speed-up theorems are 
adapted from Young [19731. Both results hold for arbitrary complexity 
measures; in the case of theorem 2.1 it is clear that our proof uses only the 
abstract properties of the time measure t t (x 1 ; in the proof of theorem 2.2, 
however, we have used some special details of the URM time measure, in 
estimating the relationship between r,. and /,. In Young's paper the above 
proof is generalised so as to work for any complexity measure. 






The Speed-up theorem pinpoints a problem when we try to define the 
complexity of a computable function f (rather than the complexity of any 
particular algorithm for f). We cannot define this as the complexity of the 
best, or fastest, algorithm for f simply because / may not have a best 
program. 

We conclude this section with an amusing consequence of the Speed- 
up theorem. Suppose that we have a URM that performs 1 step per 
second, and we replace this with a new super-improved machine that is 
100 times as fast. Then a computation P,\x) that took t,[x) seconds to 
perform on the old machine will be performed in 6(x)/10G seconds on the 
new model. Consider now the function / given by the Speed-up theorem 
with speed-up factor of 100. Suppose that / is being computed by P. on 
the new fast machine. By the Speed-up theorem there is a program P. for / 
such that 100f,(x)< t.lx) a.e.. i.e. ;,u)< /,£*>/ 100. Thus for almost all *, 
the old machine using P, computes / faster than the new machine using P,. 
We conclude that for some functions at least the new machine Is no 
superior to the old one Ion most inputs)! 



2.3. 



Exercises 

Show that in general the limitation of the inequality r(t H {x))< 

U(x) in the Speed-up theorem to utmost al! x cannot be 

improved. 

Why should we regard":he conclusion of the discussion in the 
preceding paragraph (about new and old URMsi as of theoretical 
rather than practical significance? 



3. 



Complexity classes 

Suppose that b is any total computable function. From the point 
of view of complexity, a natural class of functions comprises those 
functions having a program whose running time is bounded by b. Thus we 
define 

3.1. Definition 

Let b be a total computable function. The complexity class of it, 
G e is defined by 

Efc — {<t> t -4>t is total and r,U)sM.t>a.e.} 

-\f-f is total, computable and has a program P. with t e ix)^ 

b(x) a.e.}. 



12 Complexity of computation 



224 



Remark, The class S^ as thus defined, is ihc complexity class of b relative 
to the time measure t,ix): for any measure #,(*), we could define the 
complexity class St in the obvious way. 



If b' is another total computable function, with b(x) &b{x) for all x, of 
course «*• = <£,, ; ifb'ix ) >b{x) for all x, we would naturally expect that (£ h 
contains some new functions not in Gj, especially if b'[x) is much larger 
than b{xt. The next theorem shows that this intuition is false: we can find 
b, b' with b' greater than h by any preassigned computable factor, such 
that <£„•= S*; in fact, the theorem shows that K b' can be chosen so that 
there is no running time t e {x) that lies between bix) and b'yx) for more 
than finitely many x. Thus the theorem is called the Gap theorem. 



3.1. The Gap theorem (Borodin) 

Let rbe a iota! computable function such thai r[x \ s x. Then there 
is a total computable function b such that 

{a) for any e and x>e, if t t {x) is defined and t e ix)>b{x), then 

l e (x)> r(b{x)): hence 

Proof. We define bix) informally as follows. Define a sequence of 
numbers k < k i < . . . < fc, by 

k<,i = rikj) + \ (i<x). 

Consider the disjoint intervals' [k„rtk,f] for flsj<j. There are i-l 
such intervals, so there is at least one that does not contain any of the 
numbers ! e (x) for e < x, since there are at most x such numbers that are 
defined. Choose i r = the least i such that 

t e {x ) £ [k„ rik,)] for all e < x, 

and setMx) = fc, r . 

Now, given that i x as defined above exists on theoretical grounds, there 
is an effective procedure which will find it; we simply make repeated use 
of lemma 1 2{b) to check t e ix) e [k„ r(k,Y\ for various e and i. We conclude 
that b is a computable function, by Church's thesis. 

For the conclusion of the theorem, {a), suppose lhatx>e and U{x)ss 
b{x); by construction of b{x), wc have t t {x'> £ [bix), r(bix))]. Hence 
t e ix)>r{b(x}). 



By the mteroai >, tt] » e mean Ihc sci of ralural nnmacrs (x:c 



±x*dl 
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For pan {b), we obviously have 3* = G r! „; now note that if fe 
(S^VK*. then / has a program P, with 

l r ix)*nb(x))a.e. 
but 

t r (x)>b(x) infinitely often (otherwise /€(£,,). 
This clearly contradicts (a ). Hence (£* = 5,.^. Q 

Note. This proof is based on that given by Young [1 973]. It is easy to see 
that the function b in the theorem can be made larger than any pre- 
assigned computable function c, simply by setting k = c(x) instead of 
An = in the proof. It is also clear from the proof that the Gap theorem is 

machine independent. 

4. The elementary functions 

In this final section we introduce the class of elementary functions as an 
example of a class of computable functions that can be characterised very 
neatly in terms of the complexity classes corresponding to time of 
computation. The elementary functions form a natural and extensive 
subclass of the primitive recursive functions, as we shall see. They have 
been studied in some depth, and are of interest in their own right, quite 
apart from complexity theory. 

4,1. Definition 

(a I The class £ of elementary functions is the smallest class such 

thai 

(i; the functions * + l, U?(l s i < n \, x - y, x - y, xy are all in if, 
(ii) % is closed under substitution. 

:i : . £ is closed under the operations of forming bounded sums 
and bounded products (i.e. if fix.z) is in £ then so are the 
functions H, <f fix, z) and H r<v /U, z), as defined in chapter 2 
§4). 

Kb) A predicate M(x) is elementary if its characteristic function c M is 
elementary. 



Roughly speaking, % is the class of functions that can be obtained by 
iteration of the operations of ordinary arithmetic. It is clear that elemen- 
tary functions are computable; in fact they are all primitive recursive, by 
the results of chapter 2 §4. The next lemma helps to compile some 
examples of elementary functions and predicates. 
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4.2. Lemma 

(a ) # is closed under pounded minimalisation. 
ib'\ Elementary predicates are closed under 'not', 'and', 'or', and 
the bounded quantifiers 'Vz<y' and '3z<y'. 
Proof. 

{a} Suppose that fix. z) is elementary; recall from the proof of 

theorem 2-4.12 that 

To see that this is elementary, just notice that sg is elementary, 
since sg(x) = x — {x — 1), and 1 = ix + 1) — x. 
(frj We leave the proof as an easy exercise. Z 



The next theorem gives an indication of the fact that % is quite 
extensive. 



4.3. Theorem 

The functions m {far m eN)j and ail of :he functions listed in 
theorems 2-4.5 and 4.15 are elementary. 

Proof We shall sketch proofs for a few functions where the proof is 
non-trivial or differs significantly from that given in chapter 2. The 
terminologv of chapter 2 is used throughout. 

(ii) qt. qt(x. y)«*tzs yi> = or xU 4 1 }>y) 

= fi2 s; y(xsg((x(z +■ 1 » - y)) = 0). 
(iii) rm. rm(x, >')=»>' — x qt(x,y). 

(iv) p : . Assuming that the function Pr(x) (the characteristic 
function of 'x is prime') has been proved elementary, we have 



0g m uys2 {x = or y is the xth prime} 



B<cy<n* M - Pr < 2 > 



= M>'«2 2 YL- E Pr(2)|=o). 

(The bound p, ^ 2 7 ' is easily proved by induction, using the fact 
that p... sp»pi . . .p r -l-> 

We leave the proofs for the other functions as an exercise for 
the reader. 3 



We now show that ? is even closed under definitions by primitive 
recursion, provided that we know in advance some elementary bound on 
the function being defined by the recursion equations. 

4.4. Theorem 

Let fix) and g{x,y,z) be elementary and let h be the function 
defined from f, g by 

A (x.nj = /{*). 

M*. y + 1) = £(*.}% ft (x, >■)). 

Suppose that there is an elementary function bix.y) such that h{x,y)sa 
b ix. y ) for all x, y. Then h is elementary. 
Proof. Fix x, y ; then the calculation of hix. v ) in the usual way requires 

the calculation of the sequence of numbers hix. 0), hix, 1) A!x, y). 

These can be coded by the single number s where: 






rnyl 
P>-1 






f-r 



^11 pBf = <K*,y),say, 

where cix. y) is an elementary function. The key facts about s are 
vij l»i = h(x, 0) = f{x), (ii) for z<y, (s}.+ 2 = fr<>. 2 + l) = g(x, *, (■*)=+]> 
and (iii) h{x, y)-'*) r _|. Thus we have 

hix, y) = [u.s ^ c(x, y)t\s)\ = fix) and 

Vz<y((jl z+2 =g{x,z,(j)^i)))]» +L . 

This expression for h shows that h is elementary, by the results proved 
above. □ 

The principle of definition described in this theorem is called limited 
{primitive ) recursion. We shall sec later that this is a weaker principle than 
primitive recursion. The above result is concisely expressed by saying that 
% is closed under limited recursion. 

4.5. Corollary 

The state function o-„. hence the functions c n and j„ defined in ike 
proof of theorem 5-1.2 icomputabiiity of the universal functions) are 
elementary. Hence also the predicate T„ of Kleene's norma! form [theorem 
5-1.4) is elementary. 
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Proof. We refer to the formal proof of theorem 5-1.2 as given in 
chapter 5 and completed in the appendix to that chapter. It is mostly 
routine to establish, by using the above results, that the functions used to 
build cr n are all elementary. For the actual definition of (x„ by primitive 
recursion, note that we can obtain an elementary bound on ir„ as follows. 

It is easy to see that for any t 



c n (e,x,t}< 






and 



jje, x, r)<ln(tr). 

These two bounds are elementary functions of e. x, t once we have shown 
that p(P r ) and ln(e) are elementary functions. Putting these bounds 
together we then have an elementary bound for a p , and theorem 4.4 may 
be applied. The remainder of the proof that a r is elementary consists of 
showing that o(P t ), ln(e) and all the other functions defined in the 
appendix to chapter 5 are elementary. This is left as an exercise for the 
reader. iThe only general principle needed but not explicitly mentioned 
already is that elementary functions are closed under definition by cases; 
see exercise 4.1214a) below). 

The elementary nature of c«, />, and T n follows immediately since these 
are all defined explicitly by substitution from cr„ and other elementary 
functions. 3 

The following corollary is often expressed by saying that functions 
computable in elementary time are elementary. 

4.6. Corollary 

{a) Suppose that bix) is elementary and 0l" 1 is a total function 
suck thatt,(x)sb(x) a»e* Then $'** is elementary, 
ib) Ifbix) is elementary, then (£/, = £. 
Proof, tb) is obviously a restatement of (a) for unary functions. To 

prove (fl), suppose thai ^ n, )>)s=Mi)a.e. Then the function 

k(X) = tit ^h{x)()Je, x, t) = 0) 
is elementary, and we have 

**"'(*) = <c„(e, *,*<*))), a.e. 



Here we arc extending the use of a.e. to rt-ary predicate! M'.x) ir. the obvious 
way: Mix) holds a.c. if it holds for all but finitely many n-tuples x. 
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By the results we have proved, the right hand side is an elementary 
function. To conclude that <£'," is elementary, we observe that a function 
that is almost everywhere the same as an elementary function is elemen- 
tary (see exercise 4.12(4i>) below). D 



At this stage the reader might well be wondering whether the elemen- 
tary functions coincide with the primitive recursive functions. All parti- 
cular examples of primitive recursive functions from earlier chapters have 
been shown to be elementary. The only detectable difference between 
these classes is that for % we have only been able to prove closure under 
limited recursion. Could it be that this is only an apparent distinction? 
The answer, as we shall see below, is no. Limited recursion is a definition 
principle lhat is really weaker than primitive recursion. We will find a 
function that is primitive recursive but not elementary as a consequence 
of the next theorem to be proved below. 

Nevertheless. *f is an extremely large class of functions, and contains 
most of the functions used in practical mathematics. The class t- is a 
natural first suggestion for the class of total effectively computable 
functions, based as it is on the ordinary operations of arithmetic. Indeed. 
it has been argued (for example, by Brainerd & Landweber (19741) lhat # 
contains all practically computable functions. They argue that if fix) is 
practically computable, then there must be some number k such that/(i( 
can be computed in at most 

IT"'" 



¥ 



steps for almost all x. After all. for practical purposes, this number of 
steps quickly becomes very large in comparison with x, even for small 
values of k. Now, since the function 



is elementary (for fixed k), this means that / is elementary, by corollary 
4.6. 

Our goal in the remainder of this section is to show that the elementary 
functions can be characterised as precisely those functions that are 
computable in time 



2V' 



./ 
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for some k. As a first step towards that goal, wc have the following, which 
incidentally will give a non-elementary primitive recursive function. 

4.7. Theorem 

If fix) is elementary, there is a number k such that for all x, 

f(x)*2r/ . 
Proof Let us write bt{z) for 



2 2 / 



,*..;*! • 



then, explicitly, we have bdz) = z, b-.{z) = 2\ and b k . l (z) = T- * m 
general. (Thus, by 2 Z is meant 2 , not (2 2 )'. etc.). Note that h k ^<{z\~ 
bkib'lz)). We shall use implicitly below the fact that b k is increasing and 
that z z ^2 2 ' for all z. 

To establish the theorem, we consider each of the clauses whereby a 
function / can get into <f. Referring to definition 4.1 : 
(ii x~1^2 x : 

U?{r)£maxf*); 

x — y stnaxix. y'y. 

x+y*2m*xix.y)i£2 ma * : ' i: : 

xys{max{x, y)> 2 s2 2 ™" "*. 

(ii) Suppose that htx) = f(R 1 tx) ft.(x)), and k„ . . . , fc TO I 

are such that &£.r!£i fc {maxU)) (ls/<m), and /Yy)£ 
ft, (max (y)). Let k = maxifci. .... ftp,). Then we have 

/f(*)^A.(maK(g,(j) ,*„(*))) 

s />:(maxU»i,imaxt>}), .... £*_(max(.r}).)) 

^b,{b k {inax{x)))=bi r t(max(x)), 

<iii I Suppose thai gix, y) = Y, l<r fix, z), and that f{x,z)S 
bbimaxix, z)). Then we have 



«U.y)^ I A t (maxi>. x)) 



•■> 



•^ yfr* ImaxU, y)) 
sj>«(max(x, >•))' 

S2** """ = 6* ,z{max{j\ y .). 



The case when g is a bounded product is similar, and is left as an exercise 
■;4.12i v 6) below). Z 
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4.8. Corollary 

The function 

f 

fix)-~2V 

ts primitive recursive bus no; elementary. 

Proof To see thai f is primitive recursive, notice thai /(*)« gfr, *), 
where g is defined by 

g'>, 0)-jc, 

gU,y + l) = 2* , "' t , 

;so g is primitive recursive). 
To see that / is not elementary, notice that for every k 
f(k + [)=Jf ktl (k + 1)> £*(* + 1), 

so there is no * such that fix} s i> k {x\ for all x. (Note that / is obtained by 
'diagonalising out of if'.) D 

The penultimate step towards our goal is to show that elementary 
functions can be computed in elementary time. 

4.y. Theorem 

If fix) is elementary, there is a program P for f such that t p'ix) is 
elementary. 

Proof. We must examine the ways in which a function gets into & It is 
helpful to prove first the following general lemma. 



4.1(1. Lemma 

Letx = Ui x„). Suppose thathix.y) is elementary, and has a 

definition by recursion from functions fix) and g(x,y, zt which can be 
computed in elementary time. Then h can be computed in elementary time. 
Proof. Take programs F, G for /, g, in standard form, such that t P and 
t G are elementary. (For notations! convenience we omit here and else- 
where the superscripts from tf' for any program P whenever the 
meaning is clear.) We shall take the program H for h as given in the 
proof of theorem 2-4.4, and show that t H is elementary. Wc simply 
calculate r H (j,y) by reference to the Row diagram in fig. 2r and the 
explicit program H that is its translation. We reproduce this flow diagram 
in fig. 12c. indicating alongside each component the number of steps it 
contributes when executed by the program H. It is now a simple matter 
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to calculate that 

/«(*, y) = « ' 1 +(pOT+M*) -!)+(>• + 1) 

which is clearly an elementary funciion, since t F , tc. and h are all 

elementary. D 

Proof of theorem 4.9 

Let us consider each of the clauses in the definition of %: 

(ii The functions x - I andU!"(*)caneachbecomputedbysingle 

step programs. For x — y,x + y, xy we use lemma 4. 1 0. Consider 

x + y, for example : this is defined by recursion from the functions 

f(x) = x and g(x, y, z) = z + 1, both of which are computable in 



Fig. 12c The number of steps in a computation by recursion. 
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elementary time. Now apply lemma 4. 10. Similarly for j — y and 
-ty (for x — y we must first prove the result for x — 1, again by 
using lemma 4.10). 

(ii) Substitution. Suppose that h{x) = f{gilxi,. . . , g^rr)). and 
each of /', gw-'Sm is computable in elementary time by 
programs F, Gy, . . , C m in standard form. I>et H be the pro- 
gram for h given in the proof of theorem 2-3.1. Calculating 
directly from that program we have 

teCr)«ft.4 £ ij}{G.\-i Gi {x)+\)-p{F) 

+ ^(g,t» gbttD-f-l, 

which is an elementary function, by substitution, 
(iii) Bounded sums and products. The result is established by 
using lemma 4,10, Suppose that r{x, y'< = £ r<y /(x. z), and / is 
computable in elementary time. Then e is obtained by recursion 
from the functions and z +f(x, y) both of which are computable 
in elementary time (from (i) and (ii.) above 1. Hence, by lemma 
4.10. g is computable in elementary time. 

The proof for bounded products is similar, and is left as an 
exercise (4.12(8) below). □ 

We have now done all of the hard work! To express the charac- 
terisation of if towards which we have been working, it is helpful to 
extend complexity classes to include n-ary functions for all n. Suppose. 
then, that b[x) is a total function; let us write 

^* = {/:/ is total and /=<*!.'" for some e with 

/L"'(*)s6(inax(r)) a.e.}. 

Clearly S» = S £ r\ Unary functions. 
Now our final theorem is 



4.11. Theorem 

A total function fix) is elementary iff it is computable in time 
^ Mmaxi»), for some k. I.e. 

fessO 

Proof. Since for each fc. bkimaxixf) is an elementary function, we have 
§&£ % by corollary 4.6; hence 

fcfet) 
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For Ihc converse inclusion, let /(*) be an elementary function By 
theorem 4.9 there is a program F for /"such that i f is elementary: now by 
theorem 4.7 find a number k such that frfcr) ■< Mmaxt*}). Then / - 
so our proof is complete. 12 



e£ 



4.12. Exercises 

1. Show that ii was not strictly necessary to include the functions 
x - y and xy in the definition nf & {Hint. First obtain xy as 
a bounded sum; then obtain x-y from suitable products, 
using — ). 

2. Prove lemma 4.216). 

3. Complete the proof of theorem 4.3. 

4. i.fli Show that B is closed under definition by cases, when the 
functions and predicates in the definition are all elementary. 
ib) Show that if fix its elementary and g(ri=/lx)a.e., then gix) 
is elementary. 

5. Check all the details in the proof of corollary 4.5. 

6. Complete the proof of theorem 4.7 by showing that if g{x, y) = 
rU<t/fe*) and ftx,z)^b k {m!cnx.z)}, then g(x,y)£ 
fat.jbnaxU, y i). 

7. Give an example of a unary primitive recursive function that is 
not elementary, different from that of corollary 4.S. 

8. Prove that if / is computable in elementary time and gi>, y) = 
rL<y/U. z ^ tnen £ is computable in elementary time. 

9. Suppose that , is a complexity measure for unary functions that 
is related to t r by an elementary function r. I.e. for any e, and 
almost all x for which i t ix) is defined, 

e {x)^r(x,t e ix))zaA tAx)^r(x, <Mx)). 

For any total function b[x), let (S? be the complexity class of b 

relative to <P, i.e. 

v£f -{<&,:& is total and #,ix)^&<*)a.e.}. 

Prove that UtauG* = &» the unary elementary functions. 



Further reading For a fuller treatment of the machine independent 
theory of complexity, the reader should consult the basic paper of Blum 
[1967], or the readable overview of the theory by Hartmams & Hopcroft 
[1971]. The paper of Young [1973]. which we have already cited in 
earlier sections, simplifies some of the proofs of basic theorems. The book 
of Brainerd & Landweber [1974] has a good chapter on complexity, and 
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also gives the characterisation of various subrecursive classes of functions 
(including %t in terms of time of computation. Similar characterisations 
are also discussed in the early (in the history of complexity theory; papers 
of Ritchie [1963] and Cobham [1965], using the Turing machine tape 
measure of complexity. 
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Further study 



Our basic study of computability has been designed so that il could serve 
as a stepping stone to more advanced or more detailed study in any of 
several directions. In this brief postlude, we shall mention some of the 
areas in which further study could be pursued, and we offer some 
suggestions lor further reading. The divisions below are not hard and fast, 
and there are many interrelations between the various areas we mention. 

Computabilily Further study of the theoretical notion of computability 
(the starting point of this booki could be pursued in two directions: (oj 
more detailed examination of other equivalent approaches to compu- 
tabiliTy (which we surveyed in chapter 3): [b'\ examination of more 
restricted notions of effective computability, involving, for instance, finite 
automata and similar devices. 

Some references ■ several historical! for (a > were given in chapter 3. For 
both i.a i and ib) we suggest the books of Minsky [1967] i.a very compre- 
hensive treatment), Arbib [1969], or Engeler [1973]. 

Recursion theory We use this traditional title under which to mention 
more advanced ideas arising out of the notion of computability on foi, such 
as we began to pursue in chapters 7. and 9 to 11. Specific areas include: 

Hierarchies: there are various ways to extend the sequence 
beginning 'recursive, r.e., . . . ' to obtain a hierarchy of kinds of set, each 
kind of set having more difficult decision problem than the preceding one. 
Among the important hierarchies that have been studied are the arith- 
metic hierarchy, the hyperarithmetk hierarchy, and the analytical 
hierarchy. 



Reducibi'nties and degrees, : between ^ m and £ T there is a spec- 
trum of reducibilities that could be investigated. For the student wishing 
to delve further into Turing reducibility, the next step would be to master 
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a proof of the Friedb erg-Much nik solution to Post's problem, before 
proceeding to further results and proofs in this area, some of which we 
mentioned in chapter 9. 

Recursion in higher types, we considered briefly in chapter 10 
the question of computable functions of functions. This study can be 
extended to computability of functions of functions of functions, etc. 
Hierarchies occur naturally here also. 

The book of Rogers [1967] is the best single reference for each of these 
areas, in that it is a more advanced and comprehensive textbook which 
continues these topics where we have concluded our introduction. More 
specific sources of information about degrees are Sacks [1963], 
Shoenfield [1971] and Simpson [197?]. 

Under this heading we should also mention 



Generalised recursion theory: This is a relatively new field of 
study, in which ideas arising in computability on N are transferred to 
other structures that are not merely coded-up disguises of V This 
development has been particularly successful on certain sets called 
admissible ordinals. An introductory article having a large annotated 
bibliography is provided by Shore [1977] in the Handbook of Mathe- 
matical Logic (Barwise [1977]). 

Decidability and undecidability A good survey of unsolvable prob- 
lems in general is provided in the article by Davis [ 1 97?] in the Handbook 
of Mathematical Logic. 

For an introduction to mathematical logic, and decidability and 
undecidability in this area, there are numerous basic tests, such as 
Mendelson [1964] or Robbin [1969]. These books also give a complete 
treatment of Gddel's theorem and related results. For more advanced 
study in this area there are texts such as Bell & Machover [1977], and 
Boolos A: Jeffrey [ 1 974]. The article by Rabin [1977] surveys methods and 
results on the decidability of mathematical theories. 

Computer science The study of topics included under the heading 
C-omputabiiity above, especially finite automata, is of course relevant to 
computer science - which could be called the realm of practical compu- 
tability. Within this realm there arc two areas we have touched on. albeit 
briefly: 
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Programs and programming: further study here could include 
topics .such as the generation of programming languages and ihc structure 
of programs; and the semantics of programming languages (which we 
touched upon in chapter 10). Texts which cover these matters include 
Arhih |1969|, Bird [1976], Brainerd & Landweber |I9~41, Engeler 
[1973] and Manna [1974\ 
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What can computers do in principle? What arc 
their inherent theoretical limitations? Yhcsc arc 
questions to Which computer scientists must 
uddrcss ihem«tves. The thcorciieal framework 
which enable* such questions to be answered 
ha* hecn developed over ihc lasl fifty years 
from ihe idea of a computable function: 
Intuitively a function whose values can be 
calculated in an effective or automatic wjiy. 

This book is an introduction to com- 
putability theory lor recursion iheory as it is 
traditionally known to mathematicians). Dr 
Cutland begins with a mathematical 
characterisation of computable functions using 
a simple idealised computer (a register 
•n^h.nci; iflcr '.ome comparison »ftl Other 
characterisations, he develops the mathematical 
theory, including a full discussion of non- 
computaoility and undecidability, and Ihc 
theory of recursive and recursively enumerable 
sets. 

The later chapters provide an introduction to 
more advanced topics such as Godcl's 
incompleteness theorem, degrees of un- 
solvabiliiv, Ihe Recursion theorems and Ihc 
Iheory of complexity of computation. 
Computability is thus a branch of mathematics 
which is of relevance also to computer 
scientists and philosophers- Mathematics 
students with no prior knowledge of Ihc subject 
and computer science students who wish to 
supplement their practical expertise wiln some 
theoretical background w»ll find this hook of 
use and interest. 

A tevkwer's comment 

"Dr Cu'lncc has produced here ar excellent and 
much-needed textbook which will undoubtedly 
help to establish recursion theory as a more widely 
i&uglu branch of mainstream mathematics.' 
Titr.e* [fipher Etlucaliun Supp!tir.ti\l 

Cvver design by Alan Bartram 




.j.uuuaiiu 



Computability 



n introduction 
to recursive function 



Cambridge 

UNIVERSITY PRESS 



GO flffl 




ISSN 0-521-29465-7 

lull 



i 



